00010000:00010000:0.0F:1790919689.888175:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1790919690.909358:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919691.218908:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.218950:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.218990:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219020:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219048:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219105:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219129:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219150:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219178:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919691.219209:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306176 00000100:00100000:3.0:1790919691.219219:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306176 00000100:00100000:3.0:1790919691.219270:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306688 00000100:00100000:3.0:1790919691.219274:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306688 00000100:00100000:3.0:1790919691.219288:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306048 00000100:00100000:3.0:1790919691.219290:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306048 00000100:00100000:3.0:1790919691.219315:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306560 00000100:00100000:3.0:1790919691.219318:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306560 00000100:00100000:3.0:1790919691.219336:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790919691.219345:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958306176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919691.219408:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958306176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 64us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919691.219415:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790919691.219432:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919691.219439:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0F:1790919691.219466:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305664 00000100:00100000:2.0:1790919691.219477:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305664 00000100:00100000:2.0:1790919691.219522:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:2.0:1790919691.219529:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958305664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919691.219557:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+13:2414:x1877914958305664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.219565:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:3.0:1790919691.219580:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 140us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.219586:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305920 00000100:00100000:3.0:1790919691.219587:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1790919691.219594:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305920 00000100:00100000:2.0:1790919691.219598:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306432 00000100:00100000:3.0:1790919691.219603:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1790919691.219603:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306432 00000100:00100000:3.0:1790919691.219615:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958306048:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919691.219633:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958305792 00000100:00100000:0.0:1790919691.219636:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306304 00000100:00100000:2.0:1790919691.219637:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958305792 00000100:00100000:0.0:1790919691.219643:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306304 00000100:00100000:3.0:1790919691.219644:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958306048:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919691.219653:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1790919691.219661:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790919691.219665:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1790919691.219668:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919691.219670:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919691.219691:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.219703:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b540191a-9155-42a4-9bf1-c88998854efa+5:2414:x1877914958306432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919691.219755:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790919691.226145:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1790919691.226169:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958305920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919691.226259:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2414:x1877914958305920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 100us (7307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.226280:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1790919691.226315:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1790919691.226323:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:2414:x1877914958305792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919691.226359:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:2414:x1877914958305792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (7254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.226365:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:0.0:1790919691.226379:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1790919691.226386:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+6:2414:x1877914958306304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919691.226411:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+6:2414:x1877914958306304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (7259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.226417:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00080000:0.0:1790919691.226450:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919691.226456:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919691.226459:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919691.226461:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919691.230549:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1790919691.332499:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919691.335394:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306816 00000100:00100000:0.0:1790919691.335409:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306816 00000100:00100000:0.0:1790919691.335477:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1790919691.335487:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15698:x1877914958306816:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790919691.335626:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15698:x1877914958306816:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 140us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.335634:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1790919691.352862:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919691.352945:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958306944 00000100:00100000:2.0:1790919691.352955:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958306944 00000100:00100000:2.0:1790919691.353164:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1790919691.353177:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15698:x1877914958306944:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790919691.353288:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:15698:x1877914958306944:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 113us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.353295:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0F:1790919691.355632:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919691.361526:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307200 00000100:00100000:0.0:1790919691.361540:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307200 00000100:00100000:0.0:1790919691.361611:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919691.361623:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+21:15698:x1877914958307200:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790919691.361866:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+22:15698:x1877914958307200:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 245us (6242us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1790919691.361875:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919691.676340:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978291712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919691.676419:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919691.676424:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919691.676466:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.676488:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978292224:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.676502:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978292096:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.676524:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.676552:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978292736:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.676590:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291712 00000100:00100000:0.0:1790919691.676598:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291712 00000100:00100000:0.0:1790919691.676642:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291584 00000100:00100000:0.0:1790919691.676646:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291584 00000100:00100000:0.0:1790919691.676663:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919691.676669:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.676689:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978291712:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919691.676693:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978292608:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.676716:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1790919691.676729:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790919691.676733:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978293120:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.676755:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919691.676777:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790919691.676782:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978291712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.676784:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291968:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.676803:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790919691.676820:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919691.676826:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919691.676856:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1790919691.676893:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.676904:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790919691.676923:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292224 00000100:00100000:0.0:1790919691.676926:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292224 00000100:00100000:0.0:1790919691.676947:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292096 00000100:00100000:0.0:1790919691.676950:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292096 00000100:00100000:2.0:1790919691.676960:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.676965:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292608 00000100:00100000:0.0:1790919691.676969:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292608 00000100:00100000:0.0:1790919691.676987:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919691.676995:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.676998:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978292480:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.677036:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.677042:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978292224:12345-0@lo:400:kworker.0 Request processed in 47us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.677072:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919691.677080:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978292992:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677089:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790919691.677098:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978292096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.677109:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.677137:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978292096:12345-0@lo:400:kworker.0 Request processed in 40us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.677144:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790919691.677158:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919691.677166:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978292608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.677169:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919691.677184:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978292096:0@lo:400:kworker.0 00000100:00100000:1.0:1790919691.677193:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293120 00000100:00100000:1.0:1790919691.677199:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293120 00000100:00100000:0.0:1790919691.677204:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978292608:12345-0@lo:400:kworker.0 Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.677213:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978292608:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677223:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919691.677236:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292992 00000100:00100000:1.0:1790919691.677240:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292992 00000100:00100000:2.0:1790919691.677243:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978291840:0@lo:400:kworker.0 00000100:00080000:0.0:1790919691.677247:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919691.677253:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919691.677258:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919691.677260:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790919691.677272:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919691.677279:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919691.677284:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978293120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677286:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291968 00000100:00100000:0.0:1790919691.677292:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291968 00000100:00100000:2.0:1790919691.677319:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978292352:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677329:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292480 00000100:00100000:0.0:1790919691.677334:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292480 00000100:00100000:2.0:1790919691.677351:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.677355:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919691.677363:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978293120:12345-0@lo:400:kworker.0 Request processed in 82us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.677369:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.677375:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978292864:0@lo:400:kworker.0 00000100:00100000:1.0:1790919691.677376:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790919691.677396:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292352 00000100:00100000:1.0:1790919691.677401:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292352 00000100:00100000:2.0:1790919691.677405:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919691.677422:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292864 00000100:00100000:1.0:1790919691.677426:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292864 00000100:00100000:2.0:1790919691.677428:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978293376:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677431:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978291968:12345-0@lo:400:kworker.0 Request processed in 64us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.677441:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790919691.677445:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790919691.677455:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677463:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790919691.677467:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.677475:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919691.677508:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978292992:12345-0@lo:400:kworker.0 Request processed in 53us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919691.677517:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919691.677524:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978292480:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.677530:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978291840 00000100:00100000:0.0:1790919691.677531:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790919691.677533:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293376 00000100:00100000:2.0:1790919691.677535:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978291840 00000100:00100000:1.0:1790919691.677538:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293376 00000100:00100000:0.0:1790919691.677561:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790919691.677572:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919691.677576:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919691.677585:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978292864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.677615:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978292352:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.677622:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790919691.677627:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978292864:12345-0@lo:400:kworker.0 Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919691.678494:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790919691.678588:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790919691.678600:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.678606:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790919691.678619:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978293376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.678652:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978291840:12345-0@lo:400:kworker.0 Request processed in 56us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919691.678660:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790919691.678728:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978291840:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.678739:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978292352:0@lo:400:kworker.0 00000100:00100000:2.0:1790919691.678747:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978292864:0@lo:400:kworker.0 00010000:00080000:2.0:1790919691.678760:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f39122d500 x1877914978293376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919691.678770:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978293376:0@lo:400:kworker.0 00000100:00100000:3.0:1790919691.678827:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978293504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919691.679352:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978293376:12345-0@lo:400:kworker.0 Request processed in 735us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.679361:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790919691.679383:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919691.679398:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.679427:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978293248:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.679458:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919691.679494:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978291712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919691.679519:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978292224:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.679540:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978292736 00000100:00100000:0.0:1790919691.679545:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978292736 00000100:00100000:0.0:1790919691.679581:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919691.679588:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978292736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.679626:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978292736:12345-0@lo:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.679632:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790919691.679647:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919691.679660:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978292736:0@lo:400:kworker.0 00000100:00100000:3.0:1790919691.679793:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919691.679825:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293504 00000100:00100000:3.0:1790919691.679829:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293504 00000100:00100000:3.0:1790919691.679936:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919691.679943:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978293504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919691.679957:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1790919691.679990:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978293504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919691.679996:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790919691.680022:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978293504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919691.680150:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978291968:0@lo:400:kworker.0 00000100:00100000:3.0:1790919691.680163:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978292480:0@lo:400:kworker.0 00000100:00100000:3.0:1790919691.680174:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978292992:0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.680791:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293248 00000100:00100000:0.0:1790919691.680798:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293248 00000100:00100000:0.0:1790919691.680912:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790919691.680924:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978293248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919691.680992:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978293248:12345-0@lo:400:kworker.0 Request processed in 70us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919691.680999:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1790919691.681312:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f39122fb80 x1877914978293120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919691.681327:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978293120:0@lo:400:kworker.0 00000100:00080000:3.0:1790919691.681378:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919691.681402:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978293248:0@lo:400:kworker.0 00000001:00080000:0.0:1790919691.729903:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1790919691.729938:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95f3918543c0 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1790919691.729944:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3bdd2ec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95f391854cc0 00000020:00080000:0.0:1790919691.729948:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95f3bdd2ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95f284201c00 00000020:00080000:1.0:1790919691.730011:0:16447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1790919691.730231:0:16447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1790919691.730410:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730422:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730430:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730436:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919691.730441:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730449:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730467:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919691.730470:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919691.730474:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919691.730481:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c800/0x951c50ad15914e93 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919691.939286:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919692.190579:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919692.190653:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919692.190813:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293632 00000100:00100000:1.0:1790919692.190820:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293632 00000100:00100000:1.0:1790919692.190863:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919692.190872:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978293632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919692.190895:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919692.190936:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978293632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919692.190942:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919692.190986:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978293632:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919692.512204:0:16440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790919692.512219:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919692.512259:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790919692.512266:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790919692.700311:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919692.700343:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978293760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919692.700438:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919692.700500:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293760 00000100:00100000:2.0:1790919692.700511:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293760 00000100:00100000:2.0:1790919692.700931:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790919692.700943:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978293760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790919692.701001:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919692.701683:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919692.701716:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978293888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919692.701768:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919692.701817:0:16411:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790919692.701827:0:16411:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1790919692.702281:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978293760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1338us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919692.702301:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790919692.702331:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978293888 00000100:00100000:2.0:1790919692.702336:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978293888 00000100:00100000:2.0:1790919692.702362:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790919692.702369:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978293888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919692.702403:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919692.702459:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978293888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919692.702465:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790919692.702517:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978293760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919692.702641:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978293888:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790919692.957707:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919693.980763:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919694.493651:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790919695.013732:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919696.028173:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919696.331322:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919696.331389:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307328 00000100:00100000:3.0:1790919696.331398:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307328 00000100:00100000:3.0:1790919696.331456:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:3.0:1790919696.331465:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:2412:x1877914958307328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919696.331539:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24ec2864-d240-484b-9820-6394233cc11c+13:2412:x1877914958307328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919696.331547:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:1.0:1790919696.335031:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919696.335150:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919696.335178:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919696.335209:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307584 00000100:00100000:1.0:1790919696.335218:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307584 00000100:00100000:3.0:1790919696.335256:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307712 00000100:00100000:3.0:1790919696.335260:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307712 00000100:00100000:1.0:1790919696.335264:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307456 00000100:00100000:1.0:1790919696.335276:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307456 00000100:00100000:1.0:1790919696.335294:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1790919696.335295:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1790919696.335302:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958307584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919696.335303:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958307712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919696.335399:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919696.335409:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:2412:x1877914958307456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919696.335469:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958307712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 166us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919696.335477:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00080000:3.0:1790919696.335498:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919696.335503:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919696.335505:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919696.336432:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958307584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1127us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.336442:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1790919696.339837:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:2412:x1877914958307456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 4420us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.339853:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1790919696.347513:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919696.347556:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919696.347579:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919696.347600:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919696.347617:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307840 00000100:00100000:0.0:1790919696.347619:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919696.347627:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307840 00000100:00100000:0.0:1790919696.347640:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958307968 00000100:00100000:0.0:1790919696.347644:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958307968 00000100:00100000:0.0:1790919696.347700:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308096 00000100:00100000:0.0:1790919696.347703:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308096 00000100:00100000:1.0:1790919696.347725:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308224 00000100:00100000:0.0:1790919696.347726:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1790919696.347734:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308224 00000100:00100000:0.0:1790919696.347735:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:2412:x1877914958307968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919696.347748:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308352 00000100:00100000:1.0:1790919696.347750:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308352 00000100:00100000:1.0:1790919696.347761:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790919696.347766:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2410:x1877914958307840:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:1.0:1790919696.347783:0:17714:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914bd7 00000100:00080000:1.0:1790919696.347797:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f286ff4800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790919696.347811:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:2412:x1877914958307968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.347819:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1790919696.347845:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1790919696.347852:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2411:x1877914958308096:12345-192.168.203.11@tcp:400:kworker.0 00000001:00000004:1.0:1790919696.348165:0:17714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1790919696.348460:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919696.348524:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+5:2411:x1877914958308096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 670us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.348532:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1790919696.348558:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1790919696.348566:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b540191a-9155-42a4-9bf1-c88998854efa+5:2410:x1877914958308224:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1790919696.348580:0:17712:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914c0f 00000100:00080000:0.0:1790919696.348592:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f283a03000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919696.348626:0:17712:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:1.0:1790919696.348749:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+2:2410:x1877914958307840:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 980us (1244us total) trans 0 rc 0/0 00010000:00010000:3.0:1790919696.348754:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919696.348757:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1790919696.348771:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919696.348778:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2410:x1877914958308352:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:1.0:1790919696.348791:0:17714:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914c16 00000100:00080000:1.0:1790919696.348796:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f386d98800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919696.349660:0:17714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790919696.349851:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b540191a-9155-42a4-9bf1-c88998854efa+2:2410:x1877914958308224:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 1283us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.349861:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1790919696.349867:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b540191a-9155-42a4-9bf1-c88998854efa+2:2410:x1877914958308352:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 1085us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.349875:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00080000:0.0:1790919696.349922:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790919696.349928:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919696.349933:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919696.349937:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790919696.350136:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919696.796429:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978294016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919696.796499:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.796532:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294016 00000100:00100000:2.0:1790919696.796541:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294016 00000100:00100000:2.0:1790919696.796602:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790919696.796613:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978294016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790919696.796647:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3858759680 avail 3856662528 00000100:00080000:0.0:1790919696.796690:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919696.796770:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978294016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919696.796778:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790919696.796879:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978294144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919696.796913:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919696.797148:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294144 00000100:00100000:0.0:1790919696.797154:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294144 00000100:00100000:0.0:1790919696.797189:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919696.797204:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978294144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919696.797223:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1790919696.797282:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978294144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.797288:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790919696.797304:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919696.797483:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978294016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919696.797516:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2860fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978294144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919696.797705:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978294272:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797740:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.797767:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978294784:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797791:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.797811:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978295296:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797832:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.797851:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790919696.797857:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978294400:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797881:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.797900:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978294912:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797921:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.797937:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978295424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.797957:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919696.798005:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294272 00000100:00100000:3.0:1790919696.798010:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294272 00000100:00100000:2.0:1790919696.799164:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294784 00000100:00100000:2.0:1790919696.799172:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294784 00000100:00100000:2.0:1790919696.799209:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295296 00000100:00100000:2.0:1790919696.799212:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295296 00000100:00100000:2.0:1790919696.799236:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295424 00000100:00100000:2.0:1790919696.799239:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295424 00000100:00100000:2.0:1790919696.799895:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919696.799907:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.799991:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978294784:12345-0@lo:400:kworker.0 Request processed in 88us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919696.799999:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919696.800016:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919696.800023:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.800494:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790919696.800501:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3458:x1877914978294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.800568:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978295296:12345-0@lo:400:kworker.0 Request processed in 30us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919696.800577:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919696.800596:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790919696.800604:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978295424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919696.800639:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3458:x1877914978294272:12345-0@lo:400:kworker.0 Request processed in 136us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919696.800646:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978295424:12345-0@lo:400:kworker.0 Request processed in 41us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919696.800651:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790919696.800659:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790919696.800690:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294400 00000100:00100000:3.0:1790919696.800705:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294400 00000100:00100000:3.0:1790919696.800768:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294912 00000100:00100000:3.0:1790919696.800772:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294912 00000100:00100000:2.0:1790919696.801181:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978295424:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.801193:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978294272:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.801204:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978294784:0@lo:400:kworker.0 00010000:00080000:2.0:1790919696.801216:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b606b480 x1877914978295296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919696.801227:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978295296:0@lo:400:kworker.0 00000100:00100000:0.0:1790919696.802431:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919696.802446:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978294400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919696.802538:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978294400:12345-0@lo:400:kworker.0 Request processed in 97us (4656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.802546:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790919696.802569:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919696.802578:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978294912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790919696.802599:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919696.802609:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919696.802616:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978294912:12345-0@lo:400:kworker.0 Request processed in 38us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919696.802623:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790919696.802630:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978294656:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.802679:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.802712:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978295168:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.802738:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.802756:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978295680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919696.802779:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.802802:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790919696.803131:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978294400:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.803138:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978294528:0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.803148:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978294912:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.803790:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.803900:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978295040:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.803935:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.803958:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978295552:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.803983:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919696.804013:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294656 00000100:00100000:2.0:1790919696.804020:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294656 00000100:00100000:2.0:1790919696.804511:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978294528 00000100:00100000:2.0:1790919696.804516:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978294528 00000100:00100000:1.0:1790919696.804566:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919696.804575:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.804635:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978294656:12345-0@lo:400:kworker.0 Request processed in 61us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.804653:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919696.804672:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919696.804678:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978294528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.804710:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978294528:12345-0@lo:400:kworker.0 Request processed in 32us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.804716:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919696.804963:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295168 00000100:00100000:2.0:1790919696.804968:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295168 00000100:00100000:2.0:1790919696.805035:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295040 00000100:00100000:2.0:1790919696.805039:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295040 00000100:00100000:1.0:1790919696.805173:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295552 00000100:00100000:1.0:1790919696.805177:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295552 00000100:00100000:1.0:1790919696.805202:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790919696.805208:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.805246:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978295168:12345-0@lo:400:kworker.0 Request processed in 38us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.805252:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790919696.805272:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790919696.805278:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978295040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.805369:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978295040:12345-0@lo:400:kworker.0 Request processed in 90us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.805375:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790919696.805388:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790919696.805392:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919696.805415:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978295552:12345-0@lo:400:kworker.0 Request processed in 24us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919696.805418:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1790919696.805616:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919696.805620:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919696.805622:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919696.805623:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919696.805648:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978294528:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.805660:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978295040:0@lo:400:kworker.0 00010000:00080000:2.0:1790919696.805672:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285a9b100 x1877914978295552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919696.805694:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978295552:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.805709:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978294656:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.805719:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978295168:0@lo:400:kworker.0 00000100:00100000:2.0:1790919696.805752:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295680 00000100:00100000:2.0:1790919696.805757:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295680 00000100:00100000:2.0:1790919696.805827:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919696.805835:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978295680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919696.805850:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1790919696.805891:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978295680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919696.805898:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919696.805988:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978295680:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1790919696.860099:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1790919696.860165:0:16447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1790919696.860177:0:16447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:3.0:1790919697.053711:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919697.311990:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790919697.312013:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978295808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919697.312098:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919697.312774:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295808 00000100:00100000:1.0:1790919697.312784:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295808 00000100:00100000:1.0:1790919697.313153:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919697.313165:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978295808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919697.314708:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919697.314801:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978295808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1636us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919697.314810:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919697.315780:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978295808:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1790919697.366853:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000020:00000080:2.0:1790919697.366861:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3bd7e9000/b540191a-9155-42a4-9bf1-c88998854efa 00000020:00000080:3.0:1790919697.367011:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bd7e9000/b540191a-9155-42a4-9bf1-c88998854efa for lustre-OST0000 00000020:00000080:3.0:1790919697.367223:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f283a03000 for lustre-OST0000 00000100:00100000:2.0:1790919697.820395:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790919697.820419:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978295936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919697.820487:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919697.820586:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978295936 00000100:00100000:1.0:1790919697.820595:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978295936 00000100:00100000:1.0:1790919697.820647:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919697.820656:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978295936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919697.820692:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919697.820741:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978295936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919697.820747:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790919697.820793:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978295936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919697.821092:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790919697.821103:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978296064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919697.821133:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919697.821159:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296064 00000100:00100000:1.0:1790919697.821163:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296064 00000100:00100000:1.0:1790919697.821187:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919697.821194:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978296064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919697.821219:0:16412:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919697.821252:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978296064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919697.822456:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790919697.822514:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978296064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790919698.078174:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919699.100276:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919699.483915:0:20050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:41:39 (1790919699) 00010000:00010000:2.0:1790919700.126378:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790919700.937128:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000020:00000080:0.0:1790919700.937141:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3b65b1800/b540191a-9155-42a4-9bf1-c88998854efa 00000001:00100000:0.0:1790919700.937167:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000020:00000080:0.0:1790919700.937169:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f286ff0000/e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000020:00000080:0.0:1790919700.937184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b1800/b540191a-9155-42a4-9bf1-c88998854efa for lustre-OST0001 00000020:00000080:0.0:1790919700.937220:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286ff0000/e183cc62-cefd-4e26-96c7-4234fcebe0d8 for lustre-OST0001 00000020:00000080:0.0:1790919700.937249:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f386d98800 for lustre-OST0001 00000020:00000080:0.0:1790919700.937254:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f286ff4800 for lustre-OST0001 00010000:00010000:3.0:1790919701.149272:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919701.452630:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452678:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452710:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452741:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452780:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452809:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919701.452835:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308864 00000100:00100000:0.0:1790919701.452844:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308864 00000100:00100000:0.0:1790919701.452901:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790919701.452913:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958308864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919701.452983:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958308864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.452991:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790919701.453020:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308736 00000100:00100000:0.0:1790919701.453023:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308736 00000100:00100000:0.0:1790919701.453046:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308992 00000100:00100000:0.0:1790919701.453048:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308992 00000100:00100000:0.0:1790919701.453097:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308608 00000100:00100000:0.0:1790919701.453100:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308608 00000100:00100000:0.0:1790919701.453116:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309120 00000100:00100000:0.0:1790919701.453119:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309120 00000100:00100000:0.0:1790919701.453132:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1790919701.453138:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958308736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919701.453168:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2412:x1877914958308736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.453174:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1790919701.453186:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1790919701.453193:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:2412:x1877914958308992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919701.453216:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+6:2412:x1877914958308992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.453222:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1790919701.453252:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1790919701.453258:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:2412:x1877914958308608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919701.453284:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2860fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:2412:x1877914958308608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.453289:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1790919701.453299:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1790919701.453304:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2412:x1877914958309120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919701.453323:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b540191a-9155-42a4-9bf1-c88998854efa+5:2412:x1877914958309120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 18us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.453328:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00080000:0.0:1790919701.453343:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919701.453347:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919701.453350:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919701.453538:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958308480 00000100:00100000:2.0:1790919701.453544:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958308480 00000100:00100000:2.0:1790919701.453578:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:2.0:1790919701.453585:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:2412:x1877914958308480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919701.453616:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24ec2864-d240-484b-9820-6394233cc11c+13:2412:x1877914958308480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919701.453629:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:3.0:1790919701.917983:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978296192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919701.918073:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.918073:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919701.918087:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978296320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919701.918116:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.918145:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296192 00000100:00100000:0.0:1790919701.918153:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296192 00000100:00080000:3.0:1790919701.918178:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919701.918192:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296320 00000100:00100000:0.0:1790919701.918205:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296320 00000100:00100000:0.0:1790919701.918443:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919701.918451:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978296192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919701.918488:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919701.918532:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978296192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.918539:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919701.918571:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919701.918577:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978296320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919701.918596:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1790919701.918621:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978296320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.918626:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790919701.918664:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978296192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919701.918769:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919701.918797:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.918831:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978296320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919701.918997:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978296832:0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.919031:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919701.919067:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978297344:0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.919092:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919701.919110:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790919701.919115:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978296960:0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.919135:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919701.919154:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978297472:0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.919174:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919701.919198:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297344 00000100:00100000:1.0:1790919701.919202:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297344 00000100:00100000:2.0:1790919701.919372:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296832 00000100:00100000:2.0:1790919701.919378:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296832 00000100:00100000:0.0:1790919701.919456:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978296704:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919486:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919513:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978297216:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919534:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919551:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978297728:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919570:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919587:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790919701.919593:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978296576:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919617:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919637:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978297088:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919656:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919673:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978297600:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919691:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919701.919722:0:19527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296704 00000100:00100000:0.0:1790919701.919735:0:19527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296704 00000100:00100000:0.0:1790919701.919764:0:19527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297088 00000100:00100000:0.0:1790919701.919767:0:19527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297088 00000100:00100000:0.0:1790919701.919781:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790919701.919787:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978296704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919835:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978296704:12345-0@lo:400:kworker.0 Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.919841:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790919701.919855:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790919701.919861:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.919887:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978297088:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919701.919892:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790919701.919907:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296960 00000100:00100000:0.0:1790919701.919911:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296960 00000100:00100000:0.0:1790919701.919926:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297472 00000100:00100000:0.0:1790919701.919929:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297472 00000100:00080000:3.0:1790919701.925165:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919701.925394:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919701.925398:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919701.925516:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296448 00000100:00100000:3.0:1790919701.925527:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296448 00000100:00100000:3.0:1790919701.925594:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919701.925603:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978296448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919701.925627:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919701.925763:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978296448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (6965us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.925771:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919701.925918:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39122e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978296448:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790919701.925955:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919701.926021:0:16398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978296576 00000100:00100000:3.0:1790919701.926026:0:16398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978296576 00000100:00100000:3.0:1790919701.926072:0:16398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790919701.926080:0:16398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926118:0:16398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3461:x1877914978296576:12345-0@lo:400:kworker.0 Request processed in 39us (6500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.926124:0:16398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790919701.926156:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297216 00000100:00100000:3.0:1790919701.926160:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297216 00000100:00100000:3.0:1790919701.926175:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297728 00000100:00100000:3.0:1790919701.926177:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297728 00000100:00100000:3.0:1790919701.926194:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297600 00000100:00100000:3.0:1790919701.926198:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297600 00000100:00100000:3.0:1790919701.926211:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790919701.926217:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926266:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978296960:12345-0@lo:400:kworker.0 Request processed in 48us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.926272:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790919701.926286:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919701.926293:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978297216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926321:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978297216:12345-0@lo:400:kworker.0 Request processed in 29us (6786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.926327:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790919701.926338:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919701.926343:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978297728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926370:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3461:x1877914978297728:12345-0@lo:400:kworker.0 Request processed in 27us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.926383:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790919701.926394:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790919701.926399:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978297600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926428:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978297600:12345-0@lo:400:kworker.0 Request processed in 29us (6736us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919701.926433:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1790919701.926451:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919701.926454:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919701.926782:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978296576:0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926794:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978297088:0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926803:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978297600:0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926813:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978296704:0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926823:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978297216:0@lo:400:kworker.0 00010000:00080000:3.0:1790919701.926834:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac3b80 x1877914978297728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919701.926844:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3461:1877914978297728:0@lo:400:kworker.0 00000100:00100000:3.0:1790919701.926889:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978296960:0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.929266:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790919701.929279:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978297344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919701.929373:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3458:x1877914978297344:12345-0@lo:400:kworker.0 Request processed in 97us (10279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919701.929382:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790919701.929435:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978297344:0@lo:400:kworker.0 00000100:00100000:2.0:1790919701.932587:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790919701.932601:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978296832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919701.932691:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978296832:12345-0@lo:400:kworker.0 Request processed in 93us (13658us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919701.932699:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919701.933177:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978296832:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.943348:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790919701.943368:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.943477:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3458:x1877914978297472:12345-0@lo:400:kworker.0 Request processed in 116us (24300us total) trans 0 rc 0/0 00010000:00080000:1.0:1790919701.943556:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac1880 x1877914978297472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919701.943593:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3458:1877914978297472:0@lo:400:kworker.0 00000100:00100000:0.0:1790919701.957421:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1790919702.172303:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919702.429217:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790919702.429250:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978297856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790919702.429322:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919702.429379:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297856 00000100:00100000:2.0:1790919702.429389:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297856 00000100:00100000:2.0:1790919702.429449:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919702.429459:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978297856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919702.429483:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790919702.429530:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978297856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919702.429537:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919702.429581:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978297856:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919702.748553:0:16440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790919702.748562:0:16440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919702.748601:0:16440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790919702.748608:0:16440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790919702.788463:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919702.788551:0:16410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309376 00000100:00100000:3.0:1790919702.788560:0:16410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309376 00000100:00100000:3.0:1790919702.788619:0:16410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1790919702.788629:0:16410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+12:16584:x1877914958309376:12345-192.168.203.11@tcp:35:umount.0 00000001:00080000:3.0:1790919702.789014:0:16410:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1790919702.789216:0:16410:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1790919702.789407:0:16410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:16584:x1877914958309376:12345-192.168.203.11@tcp:35:umount.0 Request processed in 778us (951us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1790919702.789417:0:16410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000020:00080000:3.0:1790919702.789423:0:16410:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790919702.804336:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919702.804385:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919702.804421:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919702.804658:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919702.804708:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309888 00000100:00100000:2.0:1790919702.804731:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309888 00000100:00100000:2.0:1790919702.804782:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1790919702.804792:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2410:x1877914958309888:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:2.0:1790919702.804829:0:17918:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914bd0 00000100:00080000:2.0:1790919702.804838:0:17918:0:(import.c:65:import_set_state_nolock()) ffff95f286c1a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790919702.804879:0:17918:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:2.0:1790919702.805199:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e183cc62-cefd-4e26-96c7-4234fcebe0d8+2:2410:x1877914958309888:12345-192.168.203.11@tcp:9:umount.0 Request processed in 408us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919702.805208:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00010000:00010000:2.0:1790919702.805239:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919702.806035:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309632 00000100:00100000:3.0:1790919702.806043:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309632 00000100:00100000:3.0:1790919702.806339:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309504 00000100:00100000:3.0:1790919702.806343:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309504 00000100:00100000:3.0:1790919702.806359:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958309760 00000100:00100000:3.0:1790919702.806362:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958309760 00000100:00100000:3.0:1790919702.806378:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790919702.806386:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+15:2411:x1877914958309632:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919702.806399:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919702.806416:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697800/0x951c50ad15914bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fdc expref: 15 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.806434:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919702.806475:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+14:2411:x1877914958309632:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 90us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919702.806482:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1790919702.806498:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919702.806505:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+13:2411:x1877914958309504:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919702.806513:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919702.806522:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2ce00/0x951c50ad15914bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fab expref: 13 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.806545:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919702.806564:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+12:2411:x1877914958309504:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 60us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919702.806570:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919702.806584:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790919702.806590:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeb25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+11:2413:x1877914958309760:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919702.806598:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919702.806607:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2cc00/0x951c50ad15914c39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39092 expref: 11 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.806615:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919702.806645:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeb25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+10:2413:x1877914958309760:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 55us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919702.806651:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790919702.814485:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919702.815009:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958310784 00000100:00100000:1.0:1790919702.815020:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958310784 00000100:00100000:1.0:1790919702.815118:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1790919702.815292:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+15:2410:x1877914958310784:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:1.0:1790919702.815327:0:16407:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914bc2 00000020:00010000:1.0:1790919702.815343:0:16407:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f398dca800: total 0 00000100:00080000:1.0:1790919702.815349:0:16407:0:(import.c:65:import_set_state_nolock()) ffff95f398dcc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919702.815378:0:16407:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1790919702.815751:0:16394:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f398dca800: total 0 00010000:00010000:3.0:1790919702.815756:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919702.815797:0:16394:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f398dca800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1790919702.815827:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:3.0:1790919702.815831:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919702.815839:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697e00/0x951c50ad15914ce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390ae expref: 16 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.815860:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00010000:00010000:3.0:1790919702.815862:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919702.815866:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15914e0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39110 expref: 15 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.815908:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f382b81800) 00010000:00010000:3.0:1790919702.815911:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919702.815916:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380031a00/0x951c50ad15914ca9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390a0 expref: 14 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.815937:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f3a2027600) 00010000:00010000:3.0:1790919702.815940:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790919702.815944:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3bce2c000/0x951c50ad15914c8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39099 expref: 13 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.815957:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95f382b81100) 00010000:00010000:3.0:1790919702.815960:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790919702.815963:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1000/0x951c50ad15914d6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390d8 expref: 12 pid: 16408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.815976:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95f382b81d00) 00010000:00010000:3.0:1790919702.815978:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919702.815982:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f380030c00/0x951c50ad15914e69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39125 expref: 11 pid: 18910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.816123:0:16394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95f382b81f00) 00000100:00100000:1.0:1790919702.816409:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e183cc62-cefd-4e26-96c7-4234fcebe0d8+8:2410:x1877914958310784:12345-192.168.203.11@tcp:39:umount.0 Request processed in 1120us (1931us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1790919702.816418:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:3.0:1790919702.818500:0:16394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790919702.818520:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3b6015a00/0x951c50ad15914deb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39102 expref: 7 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919702.818550:0:16394:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f398dca800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1790919702.818581:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919702.818598:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919702.818600:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919702.827754:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919702.827845:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958310912 00000100:00100000:1.0:1790919702.827855:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958310912 00000100:00100000:1.0:1790919702.827913:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:1.0:1790919702.827923:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+5:2410:x1877914958310912:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:1.0:1790919702.827959:0:19266:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914bc9 00000100:00080000:1.0:1790919702.827977:0:19266:0:(import.c:65:import_set_state_nolock()) ffff95f398dcd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919702.828095:0:19266:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1790919702.828495:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e183cc62-cefd-4e26-96c7-4234fcebe0d8+3:2410:x1877914958310912:12345-192.168.203.11@tcp:39:umount.0 Request processed in 572us (746us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790919702.828504:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00010000:00010000:0.0:1790919702.829326:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919702.940370:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978297984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919702.940446:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919702.940569:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978298112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919702.940603:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919702.940672:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978297984 00000100:00100000:2.0:1790919702.940681:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978297984 00000100:00100000:2.0:1790919702.940721:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298112 00000100:00100000:2.0:1790919702.940725:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298112 00000100:00100000:2.0:1790919702.940738:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790919702.940746:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978297984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790919702.940797:0:16411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919702.940932:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919702.940944:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978298112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790919702.940967:0:19527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919702.941023:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978298112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919702.941030:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919702.941090:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978298112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919702.941739:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2871aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978297984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 991us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919702.941748:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919702.941893:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978297984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919703.196307:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919704.220338:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790919704.732973:0:17058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919704.780295:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919704.780520:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919704.780569:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919704.780709:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311040 00000100:00100000:3.0:1790919704.780724:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311040 00000100:00100000:3.0:1790919704.780821:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311296 00000100:00100000:3.0:1790919704.780824:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311296 00000100:00100000:3.0:1790919704.780838:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311168 00000100:00100000:3.0:1790919704.780841:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311168 00000100:00100000:3.0:1790919704.780860:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790919704.780871:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+12:2412:x1877914958311040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919704.780892:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919704.780920:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015200/0x951c50ad15914bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3901b expref: 12 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919704.780945:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919704.781012:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+11:2412:x1877914958311040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919704.781021:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1790919704.781041:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919704.781048:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+10:2412:x1877914958311296:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919704.781118:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919704.781147:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697a00/0x951c50ad15914c32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3908b expref: 10 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919704.781157:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919704.781179:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+9:2412:x1877914958311296:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 131us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919704.781185:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1790919704.781199:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919704.781217:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+8:2412:x1877914958311168:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790919704.781229:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919704.781238:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697000/0x951c50ad15914bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3904c expref: 8 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919704.781247:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790919704.781266:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b6068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24ec2864-d240-484b-9820-6394233cc11c+7:2412:x1877914958311168:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 61us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919704.781272:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919704.794835:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919704.795013:0:18910:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311552 00000100:00100000:0.0:1790919704.795027:0:18910:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311552 00000100:00100000:0.0:1790919704.795175:0:18910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1790919704.795192:0:18910:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+6:2410:x1877914958311552:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:0.0:1790919704.795506:0:18910:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914c01 00000020:00010000:0.0:1790919704.795519:0:18910:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f286ff3800: total 0 00000100:00080000:0.0:1790919704.795526:0:18910:0:(import.c:65:import_set_state_nolock()) ffff95f286ff1800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1790919704.795642:0:18447:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f286ff3800: total 0 00000001:00000004:0.0:1790919704.795679:0:18910:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:1.0:1790919704.795737:0:18447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f286ff3800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790919704.795910:0:18447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f3904a5e00) 00010000:00010000:1.0:1790919704.795915:0:18447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919704.795927:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d400/0x951c50ad15914cf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f390b5 expref: 5 pid: 16405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919704.795959:0:18447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f286ff3800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1790919704.795966:0:18910:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b64f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b540191a-9155-42a4-9bf1-c88998854efa+4:2410:x1877914958311552:12345-192.168.203.11@tcp:39:umount.0 Request processed in 775us (1140us total) trans 8589934628 rc 0/0 00010000:00010000:1.0:1790919704.795979:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919704.795980:0:18910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00010000:00010000:1.0:1790919704.795984:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919704.795988:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919704.796925:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919704.808319:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919704.812636:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311680 00000100:00100000:1.0:1790919704.812661:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311680 00000100:00100000:1.0:1790919704.812786:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1790919704.812802:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+5:2410:x1877914958311680:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:1.0:1790919704.812860:0:16407:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914c08 00000100:00080000:1.0:1790919704.812873:0:16407:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7e9800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1790919704.812995:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:1.0:1790919704.813408:0:16407:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1790919704.813778:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b540191a-9155-42a4-9bf1-c88998854efa+3:2410:x1877914958311680:12345-192.168.203.11@tcp:39:umount.0 Request processed in 978us (5471us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790919704.813789:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:0.0:1790919704.814414:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919704.866559:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919704.867883:0:16400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958311936 00000100:00100000:3.0:1790919704.867895:0:16400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958311936 00000100:00100000:3.0:1790919704.867965:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:3.0:1790919704.867973:0:16400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+7:2410:x1877914958311936:12345-192.168.203.11@tcp:251:umount.0 00000020:00000080:3.0:1790919704.868015:0:16400:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914b9f 00000020:00010000:3.0:1790919704.868022:0:16400:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f284008000: total 0 00000100:00080000:3.0:1790919704.868026:0:16400:0:(import.c:65:import_set_state_nolock()) ffff95f28400e800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790919704.868124:0:16400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24ec2864-d240-484b-9820-6394233cc11c+3:2410:x1877914958311936:12345-192.168.203.11@tcp:251:umount.0 Request processed in 152us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919704.868143:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000020:00010000:1.0:1790919704.868290:0:16394:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f284008000: total 0 00010000:00010000:1.0:1790919704.868372:0:16394:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f284008000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790919704.868423:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2de00/0x951c50ad15914ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f38fa4 expref: 2 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919704.868445:0:16394:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f284008000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790919704.868455:0:16394:0:(genops.c:885:class_export_put()) final put ffff95f284008000/24ec2864-d240-484b-9820-6394233cc11c 00010000:00010000:1.0:1790919704.868508:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919704.868511:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919704.868513:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919704.869291:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284008000/24ec2864-d240-484b-9820-6394233cc11c for MGS 00000020:00000080:3.0:1790919704.869351:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f28400e800 for MGS 00010000:00010000:1.0:1790919705.244665:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919706.269352:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790919706.847435:0:20247:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790919706.854164:0:20247:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790919706.854222:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.854236:0:20247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.854244:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.854251:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.854778:0:20247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790919706.854786:0:20247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790919706.854816:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919706.854820:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790919706.854825:0:20247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919706.854850:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f284be7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790919706.855750:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978298240:0@lo:39:umount.0 00000100:00100000:1.0:1790919706.855819:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919706.857676:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298240 00000100:00100000:3.0:1790919706.857688:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298240 00000100:00100000:3.0:1790919706.857738:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919706.857749:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1877914978298240:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790919706.857780:0:16408:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914793 00000100:00080000:3.0:1790919706.857801:0:16408:0:(import.c:65:import_set_state_nolock()) ffff95f3922a2000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790919706.860201:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919706.860212:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860223:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166ce00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919706.860227:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860238:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919706.860260:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919706.860266:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919706.860268:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790919706.860272:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790919706.860313:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860320:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919706.860355:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860363:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166ce00/0x951c50ad15914762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914769 expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860376:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.860378:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.860380:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919706.860390:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919706.860408:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978298368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919706.860471:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919706.860530:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298368 00000100:00100000:0.0:1790919706.860537:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298368 00000100:00100000:0.0:1790919706.860659:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919706.860670:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3460:x1877914978298368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919706.860682:0:16393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919706.860696:0:16393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ef000/0x951c50ad15914769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914762 expref: 24 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.860716:0:16393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919706.860751:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:3460:x1877914978298368:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919706.860759:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919706.860797:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978298368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919706.862015:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3457:x1877914978298240:12345-0@lo:39:umount.0 Request processed in 4261us (6189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919706.862026:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:00000080:3.0:1790919706.862037:0:16408:0:(genops.c:885:class_export_put()) final put ffff95f3b58c7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790919706.862088:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790919706.862130:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3922a2000 for lustre-MDT0000 00000100:00080000:2.0:1790919706.862218:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919706.862236:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978298240:0@lo:39:umount.0 00010000:00010000:1.0:1790919706.862304:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919706.862340:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919706.862344:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790919706.862349:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790919706.864820:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864839:0:20247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864847:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864855:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864908:0:20247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919706.864915:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864922:0:20247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864928:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.864946:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.864995:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919706.865001:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865008:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015c00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919706.865012:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865020:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919706.865027:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919706.865033:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919706.865036:0:16395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790919706.865161:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865168:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919706.865203:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865221:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015c00/0x951c50ad159146b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ba expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865234:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919706.865237:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865242:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1da00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919706.865245:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865251:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919706.865257:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919706.865262:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919706.865265:0:16395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1790919706.865277:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865284:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919706.865290:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919706.865298:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919706.865299:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919706.865301:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919706.865398:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978298624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919706.865462:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919706.865514:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790919706.865520:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978298496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919706.865542:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919706.865631:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298624 00000100:00100000:2.0:1790919706.865639:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298624 00000100:00100000:2.0:1790919706.865692:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298496 00000100:00100000:2.0:1790919706.865696:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298496 00000100:00100000:2.0:1790919706.865716:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919706.865725:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+24:3459:x1877914978298624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919706.865738:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919706.865754:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d000/0x951c50ad15914b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914b91 expref: 24 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919706.865766:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919706.865801:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+23:3459:x1877914978298624:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919706.865808:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790919706.865825:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919706.865832:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+22:3459:x1877914978298496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919706.865839:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919706.865847:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1d000/0x951c50ad159146ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159146b3 expref: 22 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919706.865867:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919706.865891:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3459:x1877914978298496:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919706.865897:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919706.865932:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978298496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919706.865941:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3459:1877914978298624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919706.866290:0:20247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919706.866297:0:20247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1da00/0x951c50ad15914b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b98 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919706.866307:0:20247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790919706.866315:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.866323:0:20247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.866329:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.866335:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.866364:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919706.866371:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.866378:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919706.866381:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.866389:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919706.866395:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919706.866400:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790919706.866402:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790919706.866434:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.866442:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790919706.866484:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978298752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919706.866520:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919706.866572:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.866583:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.866601:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.866603:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919706.866700:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298752 00000100:00100000:2.0:1790919706.866706:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298752 00000100:00100000:2.0:1790919706.866751:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919706.866758:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3aeb27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+21:3460:x1877914978298752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919706.866767:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919706.866776:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381697c00/0x951c50ad15914c71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914c6a expref: 21 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919706.866786:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919706.867048:0:20247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919706.867072:0:20247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1d200/0x951c50ad15914c6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c71 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919706.867083:0:20247:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790919706.867091:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.867097:0:20247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.867111:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.867117:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919706.867131:0:20247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790919706.867135:0:20247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1790919706.867137:0:20247:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1790919706.867163:0:20247:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1790919706.867167:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1790919706.867171:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919706.867176:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1790919706.867182:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f284297800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919706.867187:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f285da3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919706.867199:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f3b65b5800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919706.867203:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95f387ffd000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919706.867210:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff95f286ff3800 b540191a-9155-42a4-9bf1-c88998854efa 192.168.203.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1790919706.867216:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff95f398dca800 e183cc62-cefd-4e26-96c7-4234fcebe0d8 192.168.203.11@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1790919706.867221:0:20247:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff95f3bbb68000) has exports, disconnecting them 00000020:00080000:3.0:1790919706.867225:0:20247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f284297800), last request at 1790919701 00000020:00000080:3.0:1790919706.867231:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a87 00000100:00080000:3.0:1790919706.867246:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f284290800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790919706.867289:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f284297800): rc 0 00000020:00000080:3.0:1790919706.867292:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f284297800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1790919706.867307:0:20247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f285da3800), last request at 1790919701 00000020:00000080:3.0:1790919706.867311:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914930 00000100:00080000:3.0:1790919706.867317:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f285da0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790919706.867325:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f285da3800): rc 0 00000020:00000080:3.0:1790919706.867327:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f285da3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1790919706.867330:0:20247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f3b65b5800), last request at 1790919641 00000020:00000080:3.0:1790919706.867333:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914881 00000100:00080000:3.0:1790919706.867337:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f3bce55800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790919706.867341:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b65b5800): rc 0 00000020:00000080:3.0:1790919706.867343:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b65b5800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1790919706.867347:0:20247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95f387ffd000), last request at 1790919641 00000020:00000080:3.0:1790919706.867350:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914826 00000100:00080000:3.0:1790919706.867353:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f3b65b0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919706.867358:0:20247:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1790919706.867474:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f387ffd000): rc 0 00000004:00000080:3.0:1790919706.867481:0:20247:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa204c21efae0 00000100:00080000:3.0:1790919706.867497:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790919706.867500:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790919706.868402:0:20247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790919706.868427:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790919706.868526:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919706.868535:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.868545:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919706.868548:0:18447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.868557:0:18447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919706.868564:0:18447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919706.868569:0:18447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919706.868572:0:18447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790919706.868575:0:18447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790919706.868612:0:18447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.868619:0:18447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790919706.868736:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978299008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919706.868791:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919706.868952:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3aeb27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:3460:x1877914978298752:12345-0@lo:103:ldlm_bl.0 Request processed in 2191us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919706.868962:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790919706.869012:0:16392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299008 00000100:00100000:2.0:1790919706.869018:0:16392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299008 00000100:00100000:2.0:1790919706.869086:0:16392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919706.869094:0:16392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+20:3461:x1877914978299008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919706.869105:0:16392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919706.869117:0:16392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860efe00/0x951c50ad159146ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159146a5 expref: 20 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919706.869147:0:16392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919706.869184:0:16392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3461:x1877914978299008:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919706.869201:0:16392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919706.869225:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978298880:0@lo:39:umount.0 00000100:00100000:2.0:1790919706.869254:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919706.869283:0:19527:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978298880 00000100:00100000:2.0:1790919706.869286:0:19527:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978298880 00000100:00100000:2.0:1790919706.869311:0:19527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790919706.869317:0:19527:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978298880:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790919706.869341:0:19527:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159148ab 00000100:00080000:2.0:1790919706.869348:0:19527:0:(import.c:65:import_set_state_nolock()) ffff95f383f29800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790919706.869363:0:19527:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790919706.869518:0:19527:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3457:x1877914978298880:12345-0@lo:39:umount.0 Request processed in 200us (263us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790919706.869524:0:19527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1790919706.869562:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b5a26800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790919706.869569:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978298880:0@lo:39:umount.0 00000100:00100000:2.0:1790919706.869596:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3461:1877914978299008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919706.869823:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.869833:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014e00/0x951c50ad159146a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159146ac expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919706.869846:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.869848:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.869857:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919706.869869:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284297800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790919706.869924:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1790919706.869948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b5800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790919706.869977:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284290800 for lustre-MDT0000 00000020:00000080:0.0:1790919706.869981:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f285da0800 for lustre-MDT0000 00000020:00000080:0.0:1790919706.869984:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3bce55800 for lustre-MDT0000 00010000:00010000:0.0:1790919706.869993:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919706.870099:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919706.870175:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978298752:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790919706.870440:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919706.870445:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1790919706.870492:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790919706.870557:0:20247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790919706.870577:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790919706.870690:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978299136:0@lo:9:umount.0 00000100:00100000:3.0:1790919706.870739:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790919706.870788:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919706.870798:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1790919706.870808:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790919706.870877:0:20247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790919706.870889:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790919706.870929:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299136 00000100:00100000:0.0:1790919706.870935:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299136 00000100:00100000:0.0:1790919706.870985:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790919706.870994:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978299136:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790919706.871015:0:17714:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591496f 00000100:00080000:0.0:1790919706.871023:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f284295000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919706.871073:0:17714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:3.0:1790919706.871305:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978299264:0@lo:9:umount.0 00000100:00100000:3.0:1790919706.871334:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919706.871400:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299264 00000100:00100000:1.0:1790919706.871405:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299264 00000100:00100000:1.0:1790919706.871433:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919706.871440:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3457:x1877914978299264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790919706.871452:0:17712:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914aaa 00000100:00080000:1.0:1790919706.871457:0:17712:0:(import.c:65:import_set_state_nolock()) ffff95f3b4040800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790919706.871480:0:17712:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790919706.871742:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39122e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3457:x1877914978299264:12345-0@lo:9:umount.0 Request processed in 302us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919706.871749:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1790919706.871770:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790919706.871990:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95f3bbb68000) has no exports 00000100:00100000:0.0:1790919706.872635:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3457:x1877914978299136:12345-0@lo:9:umount.0 Request processed in 1640us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919706.872644:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790919706.872666:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790919706.872670:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919706.872677:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790919706.872835:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b58c0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790919706.872863:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790919706.872865:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919706.872869:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978299136:0@lo:9:umount.0 00000100:00080000:3.0:1790919706.872898:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383f4b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790919706.872913:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790919706.872915:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919706.872918:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978299264:0@lo:9:umount.0 00000020:00080000:3.0:1790919706.880748:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95f3bbb68000) has no exports 00000020:00000080:3.0:1790919706.939025:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914700 00000020:00000080:3.0:1790919706.939042:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b58c1800/lustre-QMT0000_UUID 00000020:01000000:3.0:1790919706.939150:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790919706.939533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790919706.939563:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919706.939573:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790919706.939578:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff95f3bce40000) has no exports 00000020:00000080:2.0:1790919706.941621:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159146f9 00000020:00000080:2.0:1790919706.941635:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3ad8a7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790919706.941715:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919706.941725:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790919706.941728:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3ad8a1800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790919706.941732:0:20247:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3ad8a1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790919706.941738:0:20247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1790919706.941979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3ad8a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1790919707.036458:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919707.036491:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978299392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919707.036581:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919707.036646:0:17715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299392 00000100:00100000:0.0:1790919707.036656:0:17715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299392 00000100:00100000:0.0:1790919707.036732:0:17715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790919707.036745:0:17715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978299392:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790919707.036785:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1790919707.036820:0:17715:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919707.036891:0:17715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978299392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919707.036900:0:17715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919707.037007:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978299392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919707.038707:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978299776:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.038788:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.038825:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978300288:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.038880:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.038966:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300288 00000100:00100000:2.0:1790919707.038974:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300288 00000100:00100000:1.0:1790919707.039009:0:17712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299776 00000100:00100000:1.0:1790919707.039021:0:17712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299776 00000100:00100000:2.0:1790919707.039025:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919707.039035:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3461:x1877914978300288:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790919707.039045:0:16405:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790919707.039114:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3461:x1877914978300288:12345-0@lo:400:kworker.0 Request processed in 79us (234us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919707.039130:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919707.039163:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978299904:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.039199:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.039746:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978300416:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.039777:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.039798:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790919707.039805:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978299520:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.039832:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.039859:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978300032:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.039880:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.039899:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978300544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919707.039923:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.039953:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299904 00000100:00100000:2.0:1790919707.039959:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299904 00000100:00100000:2.0:1790919707.039981:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300416 00000100:00100000:2.0:1790919707.039985:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300416 00000100:00100000:2.0:1790919707.040008:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300032 00000100:00100000:2.0:1790919707.040011:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300032 00000100:00100000:2.0:1790919707.040021:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919707.040028:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978300416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.040096:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978300416:12345-0@lo:400:kworker.0 Request processed in 68us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919707.040103:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919707.040116:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790919707.040120:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3458:x1877914978299904:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790919707.040124:0:16408:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790919707.040160:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3458:x1877914978299904:12345-0@lo:400:kworker.0 Request processed in 38us (971us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919707.040166:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790919707.040180:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919707.040185:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3458:x1877914978300032:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790919707.040199:0:16408:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790919707.040223:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3458:x1877914978300032:12345-0@lo:400:kworker.0 Request processed in 37us (342us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919707.040229:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790919707.040250:0:17716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300544 00000100:00100000:2.0:1790919707.040253:0:17716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300544 00000100:00100000:3.0:1790919707.041643:0:16401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299520 00000100:00100000:3.0:1790919707.041654:0:16401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299520 00000100:00100000:3.0:1790919707.041695:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790919707.041704:0:16401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3458:x1877914978299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919707.041729:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919707.041753:0:17712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919707.041789:0:16401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb00aa6a-67be-455f-87d9-71f2084f0f0a+19:3458:x1877914978299520:12345-0@lo:400:kworker.0 Request processed in 83us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919707.041798:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790919707.041865:0:17712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3461:x1877914978299776:12345-0@lo:400:kworker.0 Request processed in 122us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919707.041876:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919707.041912:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978299776:0@lo:400:kworker.0 00000100:00080000:3.0:1790919707.041935:0:3461:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790919707.041941:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790919707.041946:0:3461:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790919707.041954:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919707.041963:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919707.041964:0:17716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919707.042010:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b606b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978299520:0@lo:400:kworker.0 00000100:00080000:2.0:1790919707.042022:0:3458:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790919707.042026:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790919707.042029:0:3458:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790919707.042033:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919707.042038:0:3458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1790919707.042047:0:3458:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f392715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919707.042096:0:3458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4316680 x1877914978300672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919707.042120:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3458:1877914978300032:0@lo:400:kworker.0 00000100:00080000:2.0:1790919707.042133:0:3458:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790919707.042136:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3ac516800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790919707.042139:0:3458:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790919707.042154:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3ac516800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919707.042158:0:3458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1790919707.042163:0:3458:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff95f3ac516800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919707.042177:0:3458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4315500 x1877914978300800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919707.042199:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978299904:0@lo:400:kworker.0 00010000:00080000:2.0:1790919707.042215:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3b4316300 x1877914978300416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919707.042224:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978300416:0@lo:400:kworker.0 00000100:00100000:1.0:1790919707.042235:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978299648:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.042268:0:17716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978300544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790919707.042302:0:17716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790919707.042352:0:17716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978300544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 374us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919707.042513:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919707.042558:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978300160:0@lo:400:kworker.0 00000100:00100000:1.0:1790919707.042687:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919707.042754:0:16411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978299648 00000100:00100000:1.0:1790919707.042762:0:16411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978299648 00000100:00100000:1.0:1790919707.042799:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919707.042805:0:16411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3460:x1877914978299648:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790919707.042813:0:16411:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790919707.042853:0:16411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3460:x1877914978299648:12345-0@lo:400:kworker.0 Request processed in 47us (342us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919707.042859:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919707.042884:0:16408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300160 00000100:00100000:1.0:1790919707.042887:0:16408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300160 00000100:00100000:1.0:1790919707.042926:0:16408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919707.042932:0:16408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919707.042970:0:16408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978300160:12345-0@lo:400:kworker.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919707.043702:0:16408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1790919707.043733:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919707.043782:0:3460:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790919707.043787:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790919707.043792:0:3460:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790919707.043799:0:3460:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919707.043804:0:3460:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 450 00000100:00080000:1.0:1790919707.043814:0:3460:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f3b600c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919707.043847:0:3460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac3b80 x1877914978300928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919707.043865:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b6068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978299648:0@lo:400:kworker.0 00010000:00080000:1.0:1790919707.043880:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f2845a9880 x1877914978300160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919707.043907:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978300160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919707.045007:0:17716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919707.045134:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978300544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919707.047680:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978300672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790919707.047783:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919707.047884:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978300800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790919707.047912:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919707.047993:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978300928:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790919707.048032:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919707.048168:0:16412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300928 00000100:00100000:2.0:1790919707.048183:0:16412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300928 00000100:00100000:0.0:1790919707.048246:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300672 00000100:00100000:2.0:1790919707.048247:0:16412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790919707.048259:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300672 00000100:00100000:2.0:1790919707.048269:0:16412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978300928:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1790919707.048290:0:16412:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790919707.048299:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978300800 00000100:00100000:0.0:1790919707.048305:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978300800 00000100:00100000:0.0:1790919707.048354:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919707.048362:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978300672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1790919707.048379:0:16405:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790919707.048511:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978300672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 147us (727us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919707.048542:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790919707.048548:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978300800:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1790919707.048555:0:16407:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790919707.048584:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978300800:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 35us (671us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919707.048673:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790919707.050264:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919707.050275:0:3461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:3.0:1790919707.050294:0:3461:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f284009800 using connection 192.168.203.111@tcp/0@lo 00000100:00080000:1.0:1790919707.050840:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919707.050849:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790919707.050855:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978300672:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1790919707.050871:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3ac516800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919707.050875:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790919707.050879:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978300800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790919707.057119:0:3461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f2863bdf80 x1877914978301056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919707.057155:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2845a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978300288:0@lo:400:kworker.0 00000100:00100000:3.0:1790919707.057206:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978301056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790919707.057278:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919707.057544:0:19266:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301056 00000100:00100000:3.0:1790919707.057553:0:19266:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301056 00000100:00100000:0.0:1790919707.057582:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790919707.060362:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919707.060375:0:19266:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3457:x1877914978301056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1790919707.060395:0:19266:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790919707.060498:0:19266:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3457:x1877914978301056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 117us (3214us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919707.060505:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790919707.060586:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919707.060592:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919707.060596:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978301056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790919707.069939:0:16412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978300928:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 21665us (21896us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919707.069958:0:16412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1790919707.069984:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919707.069996:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790919707.070002:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978300928:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:3.0:1790919707.102449:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000001:00080000:3.0:1790919707.102466:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1790919707.102470:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f3bd7ef800/b540191a-9155-42a4-9bf1-c88998854efa 00000001:00100000:3.0:1790919707.102489:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000001:00080000:3.0:1790919707.102494:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1790919707.102497:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f398dc9800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000001:00100000:3.0:1790919707.102517:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1790919707.102525:0:7248:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1790919707.102527:0:7248:0:(genops.c:885:class_export_put()) final put ffff95f383f2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919707.102542:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bd7ef800/b540191a-9155-42a4-9bf1-c88998854efa for lustre-MDT0001 00000020:00000080:3.0:1790919707.102599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f398dc9800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 for lustre-MDT0001 00000020:00000080:3.0:1790919707.102626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f383f2f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1790919707.102647:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3bd7e9800 for lustre-MDT0001 00000020:00000080:3.0:1790919707.102651:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f398dcd000 for lustre-MDT0001 00000020:00000080:3.0:1790919707.102654:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f383f29800 for lustre-MDT0001 00000001:00100000:0.0:1790919707.111978:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b540191a-9155-42a4-9bf1-c88998854efa 00000001:00080000:0.0:1790919707.111996:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1790919707.112001:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f286ff3800/b540191a-9155-42a4-9bf1-c88998854efa 00000020:00000080:0.0:1790919707.112032:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286ff3800/b540191a-9155-42a4-9bf1-c88998854efa for lustre-MDT0000 00000020:00000080:0.0:1790919707.112108:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f286ff1800 for lustre-MDT0000 00000001:00100000:0.0:1790919707.112300:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000001:00080000:0.0:1790919707.112307:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000001:00100000:0.0:1790919707.112464:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919707.112467:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f387ffd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919707.112514:0:6467:0:(genops.c:885:class_export_put()) final put ffff95f398dca800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000020:00000080:3.0:1790919707.112944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f387ffd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1790919707.112988:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b65b0000 for lustre-MDT0000 00000020:00000080:3.0:1790919707.113269:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f398dca800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 for lustre-MDT0000 00000020:00000080:3.0:1790919707.113303:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f398dcc000 for lustre-MDT0000 00010000:00010000:0.0:1790919707.292467:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790919707.598858:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790919707.598879:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f284291800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790919707.598906:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000020:00000080:2.0:1790919707.598908:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f286c1a800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 00000020:00000080:1.0:1790919707.598962:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284291800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790919707.599014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286c1a800/e183cc62-cefd-4e26-96c7-4234fcebe0d8 for lustre-OST0000 00000020:00000080:1.0:1790919707.599035:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284295000 for lustre-OST0000 00000020:00000080:1.0:1790919707.599039:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f286c1a000 for lustre-OST0000 00010000:00010000:1.0:1790919708.318560:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790919708.958549:0:20247:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f398fa8d80 - data ffff95f3ba6e5288/ffff95f2843a7400 00000020:01000000:2.0:1790919708.958694:0:20247:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f395764f00 - data ffff95f38eba6798/ffff95f39ebb0c00 00000001:00000004:2.0:1790919708.971295:0:20247:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1790919709.138125:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790919709.138134:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790919709.138150:0:20247:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff95f391516d80 x1877914978298880/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790919716 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919709.138188:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790919709.139285:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919709.139291:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1790919709.139308:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919709.139310:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790919709.144113:0:16430:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790919709.144121:0:16430:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1790919709.144134:0:16430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790919709.145238:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790919709.145245:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790919709.145262:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919709.145264:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790919709.145911:0:16432:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790919709.145916:0:16432:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1790919709.145926:0:16432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790919709.226395:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159146c8 00000020:00000080:2.0:1790919709.226407:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b64f3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790919709.227188:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159146dd 00000020:00000080:2.0:1790919709.227195:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f2843f6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790919709.227202:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790919709.227209:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.227218:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919709.227223:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff95f3bbb6cd40) has no exports 00000004:01000000:2.0:1790919709.227368:0:20247:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790919709.227377:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591473f 00000020:00000080:2.0:1790919709.227381:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3903e2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790919709.227384:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790919709.227388:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.227393:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919709.227396:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff95f3bdfe0000) has no exports 00000020:00000080:2.0:1790919709.227401:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914738 00000020:00000080:2.0:1790919709.227403:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f383f48800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790919709.227751:0:20247:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790919709.227756:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790919709.227760:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1790919709.227765:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919709.227777:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919709.227806:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.227812:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919709.227818:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591472a 00000020:00000080:2.0:1790919709.227823:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3903e0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790919709.227827:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790919709.227830:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.227833:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919709.227835:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff95f3bce419c0) has no exports 00000020:00000080:2.0:1790919709.227839:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914723 00000020:00000080:2.0:1790919709.227841:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3903e5800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790919709.228189:0:20247:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790919709.228193:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790919709.228195:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1790919709.228200:0:20247:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790919709.228201:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919709.228223:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.228227:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1790919709.228236:0:20247:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790919709.228241:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914715 00000020:00000080:2.0:1790919709.228245:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3903e5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790919709.228249:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1790919709.228252:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.228255:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790919709.228258:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff95f3a68b99c0) has no exports 00000020:00000080:2.0:1790919709.228261:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591470e 00000020:00000080:2.0:1790919709.228264:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b5a22800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790919709.228886:0:20247:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1790919709.228890:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790919709.228893:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919709.228897:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919709.228924:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.228940:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919709.228971:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.228975:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790919709.229002:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159146e4 00000020:00000080:2.0:1790919709.229008:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b64f5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1790919709.229013:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790919709.229016:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.229020:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919709.229022:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff95f3bbb699c0) has no exports 00000020:00000080:2.0:1790919709.229038:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.229041:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790919709.229045:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159146eb 00000020:00000080:2.0:1790919709.229048:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b64f7800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790919709.229081:0:20247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3aee80800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790919709.229084:0:20247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3aee80800 3 00000020:01000004:2.0:1790919709.229088:0:20247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3aee80800 from lustre-MDT0000 00000020:00000080:2.0:1790919709.229108:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.229111:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790919709.229114:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3b64f1000/lustre-MDT0000_UUID 00000020:00000080:2.0:1790919709.229116:0:20247:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790919709.229126:0:20247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1790919709.229442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919709.229455:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2843f6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1790919709.229459:0:37:0:(genops.c:885:class_export_put()) final put ffff95f2843f6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919709.229461:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2843f6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790919709.229464:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919709.229511:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790919709.229519:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f383f48800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919709.229524:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f383f4b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790919709.229528:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3903e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919709.229529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1790919709.229532:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919709.229567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790919709.229573:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919709.229577:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b58c0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790919709.229581:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3903e6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919709.229583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1790919709.229586:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919709.229609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3903e5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790919709.229613:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b5a22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919709.229617:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b5a26800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790919709.229620:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3b58c5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919709.229622:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b58c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1790919709.229625:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790919709.229647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1790919709.229650:0:37:0:(genops.c:885:class_export_put()) final put ffff95f3b64f6800/lustre-MDD0000_UUID 00000020:00000080:3.0:1790919709.229652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1790919709.229655:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1790919709.229675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b64f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1790919709.230430:0:20247:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1790919709.230438:0:20247:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790919709.230442:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790919709.230446:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.230449:0:20247:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919709.230456:0:20247:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff95f287074800 fb00aa6a-67be-455f-87d9-71f2084f0f0a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919709.230463:0:20247:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff95f3a68bb380) has exports, disconnecting them 00000020:00080000:2.0:1790919709.230467:0:20247:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95f287074800), last request at 1790919630 00000020:00000080:2.0:1790919709.230481:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914690 00000020:00010000:2.0:1790919709.230485:0:20247:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95f287074800: total 0 00000100:00080000:2.0:1790919709.230489:0:20247:0:(import.c:65:import_set_state_nolock()) ffff95f287071000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790919709.230656:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f287074800): rc 0 00000020:00080000:2.0:1790919709.230661:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff95f3a68bb380) has no exports 00000100:00100000:3.0:1790919709.231072:0:16398:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff95f3a6b0e600:16398] 0 exiting: rc = 1 00000100:00100000:3.0:1790919709.231163:0:16400:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff95f387172000:16400] 1 exiting: rc = 0 00000020:00010000:1.0:1790919709.231251:0:18447:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95f287074800: total 0 00010000:00010000:1.0:1790919709.231256:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919709.231292:0:18447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff95f287074800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790919709.231319:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014400/0x951c50ad159147cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159147c4 expref: 14 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231334:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860efa00/0x951c50ad1591469e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914697 expref: 13 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231344:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6014000/0x951c50ad15914b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914b83 expref: 12 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231359:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860ee200/0x951c50ad15914a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914a41 expref: 11 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231369:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860efc00/0x951c50ad1591491b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914914 expref: 10 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231379:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1c400/0x951c50ad15914c47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914c40 expref: 9 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231400:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166de00/0x951c50ad1591486c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914865 expref: 8 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231410:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f38166c600/0x951c50ad159147bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159147b6 expref: 7 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231422:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381696200/0x951c50ad15914c55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914c4e expref: 6 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231435:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f381696800/0x951c50ad15914c63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914c5c expref: 5 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231447:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d600/0x951c50ad15914a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad15914a6b expref: 4 pid: 16400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231457:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3b6015000/0x951c50ad159148f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159148ea expref: 3 pid: 16398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231467:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f2860eea00/0x951c50ad159147af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x951c50ad159147a8 expref: 2 pid: 16401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919709.231478:0:18447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff95f287074800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1790919709.231491:0:18447:0:(genops.c:885:class_export_put()) final put ffff95f287074800/fb00aa6a-67be-455f-87d9-71f2084f0f0a 00010000:00010000:1.0:1790919709.231513:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919709.231515:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919709.231517:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919709.231555:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f287074800/fb00aa6a-67be-455f-87d9-71f2084f0f0a for MGS 00000020:00000080:3.0:1790919709.231595:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f287071000 for MGS 00000100:00100000:2.0:1790919709.231795:0:16401:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff95f3b646f400:16401] 2 exiting: rc = 0 00000100:00100000:2.0:1790919709.249312:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249322:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249328:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249334:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249340:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249346:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249352:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249358:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249364:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249370:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249376:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249381:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249387:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249392:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249398:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249403:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249408:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249413:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249418:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249424:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249429:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249433:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249439:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249445:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249450:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249455:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249461:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249465:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249471:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249475:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249480:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249496:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249501:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249507:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249512:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249518:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249523:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249528:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249533:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249538:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249543:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249549:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249554:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249558:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249564:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249580:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249586:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249591:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249703:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249709:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249714:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249720:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249725:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249731:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249736:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249742:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249747:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249752:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249757:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249762:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249767:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249773:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249777:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919709.249782:0:20247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1790919709.250251:0:20247:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790919709.250255:0:20247:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1790919709.251352:0:20247:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3b65c8840 - data ffff95f38eb11798/ffff95f28467f000 00000020:01000000:2.0:1790919709.251452:0:20247:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f383d3bf00 - data ffff95f3ba6f5af8/ffff95f283bf9800 00000020:00000080:2.0:1790919709.252005:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914674 00000020:00000080:2.0:1790919709.252012:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3aee84000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790919709.252186:0:20247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3aee80800 from MGS, refs=2 00000020:01000004:2.0:1790919709.252190:0:20247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3aee80800 2 00000020:01000004:2.0:1790919709.252193:0:20247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3aee80800 from MGS 00000020:00000080:2.0:1790919709.252227:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.252234:0:20247:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790919709.252236:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3aee86000/MGS 00000020:00000080:2.0:1790919709.252239:0:20247:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3aee86000/MGS for MGS 00000020:01000000:2.0:1790919709.252244:0:20247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790919709.252292:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790919709.252295:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.252300:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919709.252306:0:20247:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95f383fa8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919709.252311:0:20247:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff95f38d5819c0) has exports, disconnecting them 00000020:00080000:2.0:1790919709.252316:0:20247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95f383fa8800), last request at 1790919630 00000020:00000080:2.0:1790919709.252319:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914777 00000020:00080000:2.0:1790919709.252325:0:20247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f383fa8800): rc 0 00000020:00000080:2.0:1790919709.252329:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f383fa8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790919709.252566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3aee84000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790919709.253327:0:20247:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790919709.253333:0:20247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919709.253338:0:20247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919709.253343:0:20247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919709.253473:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919709.253479:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790919709.253484:0:20247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3aee80800 1 00000020:00000080:2.0:1790919709.253487:0:20247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914666 00000020:00000080:2.0:1790919709.253493:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3aee83800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790919709.253498:0:20247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790919709.253514:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919709.253517:0:20247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790919709.253520:0:20247:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff95f3a68b8000) has no exports 00000020:00000080:3.0:1790919709.253834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f383fa8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790919709.257472:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284be7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790919709.257490:0:8:0:(genops.c:885:class_export_put()) final put ffff95f391986800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790919709.257494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f391986800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790919709.257500:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790919709.257606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3aee83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790919709.295047:0:20247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919709.295087:0:20247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790919709.295095:0:20247:0:(genops.c:885:class_export_put()) final put ffff95f3aee81000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790919709.295167:0:20247:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3aee81000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790919709.295188:0:20247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790919709.295443:0:20247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f3aee87800 00000020:02000400:3.0:1790919709.295528:0:20247:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790919709.344820:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919710.368160:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790919711.219364:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919711.219374:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f3b4046800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790919711.219398:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4046800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790919711.219445:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b4040800 for lustre-OST0001 00010000:00010000:1.0:1790919711.388503:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790919711.897589:0:20402:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790919711.908218:0:20402:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1790919711.908264:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.908277:0:20402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.908284:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.908291:0:20402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.908314:0:20402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790919711.908320:0:20402:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790919711.908349:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919711.908354:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790919711.908380:0:20402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919711.908386:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f3ac516800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790919711.908391:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919711.908392:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790919711.908395:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790919711.909184:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919711.909193:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919711.909210:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166cc00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919711.909214:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919711.909222:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919711.909229:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919711.909233:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919711.909236:0:16395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790919711.909238:0:16395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790919711.909272:0:16395:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919711.909278:0:16395:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790919711.909336:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978301184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919711.909412:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919711.909536:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919711.909544:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166cc00/0x951c50ad15914865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad1591486c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919711.909557:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919711.909559:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919711.909562:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919711.909594:0:16391:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301184 00000100:00100000:1.0:1790919711.909601:0:16391:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301184 00000100:00100000:1.0:1790919711.910463:0:16391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919711.910472:0:16391:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3460:x1877914978301184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790919711.910488:0:16391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919711 with bad export cookie 10744551515320567440 00010000:00010000:3.0:1790919711.911201:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911213:0:20402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911219:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911225:0:20402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911242:0:20402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919711.911248:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911254:0:20402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911259:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911264:0:20402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911291:0:20402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919711.911297:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911304:0:20402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911309:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911315:0:20402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911326:0:20402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790919711.911331:0:20402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911336:0:20402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911342:0:20402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911348:0:20402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919711.911355:0:20402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1790919711.911358:0:20402:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1790919711.912549:0:20402:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1790919711.912554:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1790919711.912559:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919711.912564:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1790919711.912571:0:20402:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff95f284296000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919711.912577:0:20402:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff95f283a02000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790919711.912582:0:20402:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff95f3bce43380) has exports, disconnecting them 00000020:00080000:3.0:1790919711.912587:0:20402:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff95f284296000), last request at 1790919707 00000020:00000080:3.0:1790919711.912594:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a9c 00000100:00080000:3.0:1790919711.912610:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f284292000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790919711.912853:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790919711.912867:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912876:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1ce00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919711.912879:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912888:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919711.912896:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919711.912902:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919711.912905:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1790919711.912908:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1790919711.912941:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912947:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919711.912968:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912975:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159147c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147cb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912989:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790919711.912992:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.912997:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919711.913006:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.913012:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919711.913019:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919711.913024:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919711.913026:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790919711.913028:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790919711.913042:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.913048:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919711.913137:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.913145:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015e00/0x951c50ad15914b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914b8a expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790919711.915776:0:20402:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f284296000): rc 0 00000020:00000080:3.0:1790919711.915783:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f284296000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1790919711.915800:0:20402:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff95f283a02000), last request at 1790919707 00000020:00000080:3.0:1790919711.915806:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914945 00000100:00080000:3.0:1790919711.915817:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f283a02800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790919711.915832:0:20402:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f283a02000): rc 0 00000020:00000080:3.0:1790919711.915834:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f283a02000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1790919711.915841:0:20402:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa204c18afae0 00000100:00080000:3.0:1790919711.915860:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790919711.915863:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1790919711.916522:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919711.916532:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916541:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919711.916546:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916557:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919711.916577:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919711.916584:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790919711.916587:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790919711.916590:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790919711.916627:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916634:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919711.916649:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916655:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014200/0x951c50ad15914c5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad15914c63 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916667:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919711.916671:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916677:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6015800 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919711.916680:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916687:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790919711.916688:0:20402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919711.916696:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:0.0:1790919711.916697:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919711.916715:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790919711.916718:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790919711.916720:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790919711.916737:0:16394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916743:0:16394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919711.916753:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916760:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015800/0x951c50ad159147b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x951c50ad159147bd expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919711.916773:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919711.916775:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919711.916778:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919711.916798:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978301440:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790919711.916838:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790919711.916841:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1790919711.916854:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919711.916864:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919711.916918:0:20402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790919711.916932:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790919711.916943:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790919711.916951:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1790919711.916960:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919711.917026:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978301824:0@lo:9:umount.0 00000100:00100000:3.0:1790919711.917098:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919711.917138:0:20402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790919711.917150:0:20402:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790919711.917249:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919711.917257:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978301568:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1790919711.917602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284296000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1790919711.917657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f283a02000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1790919711.917688:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284292000 for lustre-MDT0001 00000020:00000080:2.0:1790919711.917692:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f283a02800 for lustre-MDT0001 00000100:00100000:0.0:1790919711.918853:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919711.918927:0:19148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301440 00000100:00100000:0.0:1790919711.918934:0:19148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301440 00000100:00100000:2.0:1790919711.919267:0:16393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301568 00000100:00100000:2.0:1790919711.919272:0:16393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301568 00000100:00100000:0.0:1790919711.920496:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919711.920506:0:19148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3458:x1877914978301440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790919711.920514:0:19148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919711 with bad export cookie 10744551515320567440 00000100:00100000:0.0:1790919711.920598:0:19148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3458:x1877914978301440:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (3734us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790919711.920621:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919711.920658:0:17714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301824 00000100:00100000:0.0:1790919711.920664:0:17714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301824 00000100:00100000:0.0:1790919711.920712:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790919711.920719:0:17714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3457:x1877914978301824:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790919711.920744:0:17714:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914ab1 00000100:00080000:0.0:1790919711.920752:0:17714:0:(import.c:65:import_set_state_nolock()) ffff95f285da3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790919711.920785:0:17714:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:0.0:1790919711.922584:0:17714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3457:x1877914978301824:12345-0@lo:9:umount.0 Request processed in 1859us (5479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919711.922596:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790919711.922647:0:3458:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790919711.922651:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3be491000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790919711.922656:0:3458:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:3.0:1790919711.922795:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff95f3bce43380) has no exports 00000100:00100000:3.0:1790919711.923212:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978301952:0@lo:9:umount.0 00000100:00100000:3.0:1790919711.923257:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919711.923296:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392712000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790919711.923307:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790919711.923309:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919711.923312:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978301824:0@lo:9:umount.0 00000100:00100000:3.0:1790919711.923342:0:17918:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978301952 00000100:00100000:3.0:1790919711.923348:0:17918:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978301952 00000100:00100000:3.0:1790919711.923386:0:17918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790919711.923394:0:17918:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3457:x1877914978301952:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790919711.923415:0:17918:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914ab8 00000100:00080000:3.0:1790919711.923423:0:17918:0:(import.c:65:import_set_state_nolock()) ffff95f285da5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790919711.923444:0:17918:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790919711.923690:0:17918:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3457:x1877914978301952:12345-0@lo:9:umount.0 Request processed in 296us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919711.923697:0:17918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1790919711.923716:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919711.923720:0:16402:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790919711.923742:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f387168800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790919711.923757:0:3457:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790919711.923759:0:3457:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790919711.923773:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978301952:0@lo:9:umount.0 00000100:00100000:2.0:1790919711.923906:0:16393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919711.923912:0:16393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3458:x1877914978301568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790919711.923917:0:16393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790919711 with bad export cookie 10744551515320567440 00000100:00100000:2.0:1790919711.923954:0:16393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3458:x1877914978301568:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (5102us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919711.923960:0:16393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1790919711.944992:0:3458:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790919711.944997:0:3458:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790919711.945007:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f285ac2a00 x1877914978301184/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919727 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919711.945024:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae84ad80 x1877914978301440/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919727 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919711.945035:0:3458:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae84aa00 x1877914978301568/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790919727 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790919711.945544:0:3458:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790919711.945548:0:3458:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790919711.945550:0:3458:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790919711.949539:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb00aa6a-67be-455f-87d9-71f2084f0f0a:0:1877914978301312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919711.950784:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:0:1877914978301696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919711.950805:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3460:1877914978301184:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1790919711.950975:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3be491000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919711.950983:0:3458:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1790919711.951011:0:3458:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f3be491000 using connection 192.168.203.111@tcp/0@lo 00010000:00010000:0.0:1790919711.951024:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919711.952279:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919711.952292:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919711.954170:0:3458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae848a80 x1877914978302080/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919711.955371:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3457:1877914978302080:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1790919711.955490:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877914978302080 offset 0 length 520: 4 00000100:00100000:0.0:1790919711.955554:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978301568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919711.955561:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3458:1877914978301440:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1790919711.963972:0:16391:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877914978301184 offset 224 length 224: 4 00000100:00100000:1.0:1790919711.964247:0:16391:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3460:x1877914978301184:12345-0@lo:103:ldlm_bl.0 Request processed in 53773us (54833us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790919711.964258:0:16391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:2.0:1790919711.972756:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff95f3bce43380) has no exports 00000020:01000000:1.0:1790919712.031871:0:20402:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f398fa8120 - data ffff95f3bd8bb510/ffff95f2843a5000 00000020:01000000:1.0:1790919712.032033:0:20402:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3ae6e2660 - data ffff95f3a6c72438/ffff95f386866c00 00000001:00000004:1.0:1790919712.043209:0:20402:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1790919712.086518:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919712.086527:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919712.086535:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790919712.087967:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790919712.087973:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1790919712.087989:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919712.087991:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790919712.088251:0:17047:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790919712.088256:0:17047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1790919712.088265:0:17047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1790919712.089899:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790919712.089905:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1790919712.089930:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919712.089932:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790919712.090846:0:17049:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790919712.090853:0:17049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1790919712.090864:0:17049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790919712.128146:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159147d9 00000020:00000080:0.0:1790919712.128171:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3b6008800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790919712.128995:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159147ee 00000020:00000080:0.0:1790919712.129003:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f284bd4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790919712.129009:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1790919712.129015:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.129025:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919712.129029:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff95f3bce44d40) has no exports 00000004:01000000:0.0:1790919712.129223:0:20402:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790919712.129240:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914842 00000020:00000080:0.0:1790919712.129246:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f284002000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790919712.129250:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790919712.129254:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.129259:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790919712.129261:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff95f3bdfe3380) has no exports 00000020:00000080:0.0:1790919712.129266:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591483b 00000020:00000080:0.0:1790919712.129269:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f38716c000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1790919712.129612:0:20402:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790919712.129617:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790919712.129621:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1790919712.129626:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919712.129629:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919712.129659:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.129667:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790919712.129673:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591482d 00000020:00000080:0.0:1790919712.129678:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f39281d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790919712.129682:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790919712.129685:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.129687:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790919712.129690:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff95f3908a8000) has no exports 00000020:00000080:0.0:1790919712.129693:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591481f 00000020:00000080:0.0:1790919712.129696:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f392715000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1790919712.130001:0:20402:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790919712.130004:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790919712.130005:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1790919712.130009:0:20402:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790919712.130011:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919712.130039:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.130044:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1790919712.130077:0:20402:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790919712.130083:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914811 00000020:00000080:0.0:1790919712.130094:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f392714000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790919712.130098:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1790919712.130101:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.130105:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790919712.130108:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff95f3908acd40) has no exports 00000020:00000080:0.0:1790919712.130112:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591480a 00000020:00000080:0.0:1790919712.130114:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3b600b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790919712.130901:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6008800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790919712.130922:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284bd4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1790919712.130928:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284002000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790919712.130932:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f38716c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790919712.130937:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f387168800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790919712.130943:0:37:0:(genops.c:885:class_export_put()) final put ffff95f2862ef000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919712.130946:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862ef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790919712.130951:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790919712.131023:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f39281d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790919712.131029:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f392715000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790919712.131034:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f392712000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790919712.131038:0:37:0:(genops.c:885:class_export_put()) final put ffff95f38716c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919712.131040:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f38716c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1790919712.131042:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790919712.131083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f392714000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790919712.131088:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b600b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790919712.145394:0:20402:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1790919712.145403:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919712.145408:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790919712.145416:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919712.145515:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.145528:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790919712.145630:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.145635:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790919712.145640:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3b600d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919712.145645:0:20402:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b600d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790919712.145656:0:20402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790919712.145796:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159147f5 00000020:00000080:0.0:1790919712.145803:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f284bd0000/lustre-MDD0001_UUID 00000020:00000080:3.0:1790919712.145831:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3b600c800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790919712.145837:0:37:0:(genops.c:885:class_export_put()) final put ffff95f392717000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919712.145838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f392717000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790919712.145844:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790919712.146263:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1790919712.146268:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.146274:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919712.146277:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff95f3908ab380) has no exports 00000020:00000080:0.0:1790919712.146299:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.146302:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1790919712.146307:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159147fc 00000020:00000080:0.0:1790919712.146311:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f284bd2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790919712.146557:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284bd0000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1790919712.146569:0:37:0:(genops.c:885:class_export_put()) final put ffff95f39281d000/lustre-MDD0001_UUID 00000020:00000080:3.0:1790919712.146572:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f39281d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1790919712.146576:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1790919712.146762:0:20402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f391982800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1790919712.146767:0:20402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f391982800 2 00000020:01000004:0.0:1790919712.146770:0:20402:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f391982800 from lustre-MDT0001 00000020:00000080:0.0:1790919712.146798:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.146806:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1790919712.146808:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3b600b800/lustre-MDT0001_UUID 00000020:00000080:0.0:1790919712.146811:0:20402:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b600b800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1790919712.146825:0:20402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1790919712.146852:0:20402:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1790919712.146855:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1790919712.146858:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.146861:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919712.146867:0:20402:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff95f3ac514800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919712.146872:0:20402:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff95f3b42b0000) has exports, disconnecting them 00000020:00080000:0.0:1790919712.146877:0:20402:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff95f3ac514800), last request at 1790919641 00000020:00000080:0.0:1790919712.146881:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591487a 00000020:00080000:0.0:1790919712.146891:0:20402:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3ac514800): rc 0 00000020:00000080:0.0:1790919712.146894:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3ac514800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790919712.147113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f284bd2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790919712.147120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3ac514800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000100:00080000:3.0:1790919712.159911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919712.159922:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919712.159925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919712.159928:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790919712.159933:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919712.159940:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1790919712.159945:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790919712.159957:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f392715800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919712.159996:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a001bb80 x1877914978302208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919712.160048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790919712.160075:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790919712.160077:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919712.160081:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 516 00000100:00080000:3.0:1790919712.160083:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790919712.160087:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f284009800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919712.160100:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a0018380 x1877914978302464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919712.160161:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978302336:0@lo:400:kworker.0 00000100:00100000:3.0:1790919712.160251:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919712.160352:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978302208:0@lo:38:kworker.0 00000100:00100000:2.0:1790919712.160397:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919712.160435:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978302464:0@lo:38:kworker.0 00000100:00100000:2.0:1790919712.160459:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919712.160496:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978302336 00000100:00100000:2.0:1790919712.160503:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978302336 00000100:00100000:2.0:1790919712.160539:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978302208 00000100:00100000:2.0:1790919712.160542:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978302208 00000100:00100000:2.0:1790919712.160569:0:16405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978302464 00000100:00100000:2.0:1790919712.160573:0:16405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978302464 00000100:00100000:2.0:1790919712.160586:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919712.160593:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3461:x1877914978302336:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790919712.160601:0:16405:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790919712.160640:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3461:x1877914978302336:12345-0@lo:400:kworker.0 Request processed in 46us (389us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790919712.160647:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919712.160663:0:16405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790919712.160666:0:16405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978302208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919712.160682:0:16405:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790919712.161515:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978302592:0@lo:400:kworker.0 00000100:00100000:0.0:1790919712.161562:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:01000000:0.0:1790919712.161606:0:20402:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790919712.161610:0:20402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919712.161613:0:20402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790919712.161618:0:20402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790919712.162461:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919712.162472:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790919712.162478:0:20402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f391982800 1 00000020:00000080:0.0:1790919712.162484:0:20402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159147a1 00000020:00000080:0.0:1790919712.162492:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3b65b2000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790919712.162499:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790919712.162504:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919712.162508:0:20402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790919712.163462:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff95f3b42b4d40) has no exports 00000100:00100000:3.0:1790919712.163649:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978302592 00000100:00100000:3.0:1790919712.163659:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978302592 00000100:00100000:3.0:1790919712.163691:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790919712.163698:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978302464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790919712.163716:0:16407:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790919712.163792:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978302464:12345-0@lo:38:kworker.0 Request processed in 92us (3331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790919712.163799:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790919712.163816:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790919712.163820:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3458:x1877914978302592:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790919712.163827:0:16407:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790919712.163862:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3458:x1877914978302592:12345-0@lo:400:kworker.0 Request processed in 39us (2299us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790919712.163868:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000020:00000080:3.0:1790919712.163889:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3ac516800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790919712.163895:0:37:0:(genops.c:885:class_export_put()) final put ffff95f2862eb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1790919712.163898:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f2862eb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1790919712.163905:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1790919712.163953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000100:00080000:3.0:1790919712.164733:0:3461:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790919712.164739:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f285da2800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790919712.164757:0:3461:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790919712.174204:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919712.174212:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919712.174217:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978302464:0@lo:38:kworker.0 00000100:00080000:0.0:1790919712.174321:0:3458:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790919712.174336:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790919712.174341:0:3458:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790919712.174346:0:3458:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919712.174350:0:3458:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:0.0:1790919712.174363:0:3458:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff95f3bd7ec800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919712.174398:0:3458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84aa00 x1877914978302720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919712.174419:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978302592:0@lo:400:kworker.0 00000100:00100000:2.0:1790919712.174641:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978302720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790919712.174699:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919712.174871:0:16407:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978302720 00000100:00100000:2.0:1790919712.174879:0:16407:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978302720 00000100:00100000:2.0:1790919712.174913:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790919712.174920:0:16407:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978302720:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1790919712.174938:0:16407:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919712.175169:0:16407:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978302720:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 63us (285us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919712.175179:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1790919712.176531:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919712.176540:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919712.176546:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978302720:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790919712.182570:0:16405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978302208:12345-0@lo:38:kworker.0 Request processed in 21893us (22164us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919712.182585:0:16405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1790919712.182638:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919712.182643:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919712.182647:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978302208:0@lo:38:kworker.0 00000020:00000080:2.0:1790919712.199729:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919712.199743:0:20402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1790919712.199749:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f391980800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790919712.199753:0:20402:0:(genops.c:844:class_export_destroy()) destroying export ffff95f391980800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1790919712.199761:0:20402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1790919712.199876:0:20402:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f391981000 00000020:01000000:2.0:1790919712.199897:0:20402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790919712.199902:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919712.199906:0:20402:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790919712.199909:0:20402:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff95f3bbb6b380) has no exports 00000100:00100000:2.0:1790919712.199991:0:18910:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff95f283bb6400:18910] 3 exiting: rc = 0 00000100:00100000:2.0:1790919712.200116:0:16407:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff95f283bcde00:16407] 1 exiting: rc = 0 00000100:00100000:2.0:1790919712.200199:0:16405:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff95f283bcd400:16405] 0 exiting: rc = 1 00000100:00100000:2.0:1790919712.202210:0:19266:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff95f3b622f600:19266] 4 exiting: rc = 0 00000100:00080000:3.0:1790919712.205958:0:3461:0:(import.c:65:import_set_state_nolock()) ffff95f285da2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790919712.205970:0:3461:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1790919712.205995:0:3461:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff95f285da2800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919712.206646:0:3461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a0019f80 x1877914978302848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919712.206706:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978302848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790919712.206781:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919712.206828:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978302336:0@lo:400:kworker.0 00000100:00100000:1.0:1790919712.212559:0:16408:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff95f3bbc96e00:16408] 2 exiting: rc = 0 00000100:00100000:2.0:1790919712.213660:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213669:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213675:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213681:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213687:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213693:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213699:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213714:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213721:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213727:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213732:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213738:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213744:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213749:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213755:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213761:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213766:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213771:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213777:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213782:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213788:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213794:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213799:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213804:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213810:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213816:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213821:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213826:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213832:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213838:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213844:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213850:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213855:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213873:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213878:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213884:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213890:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213896:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213902:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213907:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213912:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213918:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213923:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213928:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213933:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213938:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213944:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.213949:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214217:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214226:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214233:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214237:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214242:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214247:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214252:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214258:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214264:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214270:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214276:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214281:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214288:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214294:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214299:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.214313:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919712.218697:0:16409:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff95f3ae852c00:16409] 0 exiting: rc = 1 00000100:00100000:3.0:1790919712.218795:0:16410:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff95f285784c00:16410] 1 exiting: rc = 0 00000100:00100000:2.0:1790919712.222305:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222317:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222325:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222330:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222352:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222358:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222364:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222369:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222374:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222379:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222384:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222389:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222394:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222399:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222404:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222409:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222414:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222419:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222424:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222429:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222435:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222440:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222444:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222450:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222455:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222460:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222465:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222469:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222474:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222479:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222484:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222488:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222493:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222498:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222504:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222511:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222515:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222522:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222527:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222539:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222544:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222550:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222555:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222560:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222565:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222570:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222576:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222581:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222586:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222590:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222595:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222599:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222604:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222608:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222614:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222619:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222623:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222627:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222632:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222636:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222641:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222646:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222650:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.222655:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919712.223668:0:19527:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff95f38692c600:19527] 2 exiting: rc = 0 00000100:00100000:2.0:1790919712.223674:0:16412:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff95f3bbc96200:16412] 1 exiting: rc = 0 00000100:00100000:1.0:1790919712.224876:0:16411:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff95f3952c0400:16411] 0 exiting: rc = 1 00000100:00100000:2.0:1790919712.225479:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225488:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225504:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225512:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225518:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225525:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225532:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225551:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225561:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225582:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225588:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225593:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225598:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225604:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225609:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225615:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225622:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225628:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225635:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225659:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225666:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225674:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225681:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225689:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225696:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225702:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225723:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225730:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225736:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225741:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225747:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225770:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225777:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225782:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225788:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225794:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225800:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225807:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225813:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225820:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225827:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225832:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225840:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225864:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225877:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225882:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225887:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225894:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225899:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225906:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225911:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225917:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225925:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225930:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.225937:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226036:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226045:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226131:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226140:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226145:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226162:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226170:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226177:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.226184:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.240837:0:16413:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff95f398c7d400:16413] 0 exiting: rc = 1 00000100:00100000:3.0:1790919712.241109:0:16414:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff95f398c7ca00:16414] 1 exiting: rc = 0 00000100:00100000:0.0:1790919712.241360:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241369:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241374:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241378:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241384:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241391:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241396:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241401:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241406:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241412:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241417:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241422:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241427:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241431:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241436:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241441:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241445:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241450:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241455:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241460:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241464:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241481:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241485:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241490:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241495:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241499:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241504:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241509:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241514:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241518:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241523:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241528:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241533:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241538:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241543:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241548:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241554:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241559:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241564:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241569:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241573:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241578:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241583:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241589:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241594:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241599:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241604:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241609:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241614:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241619:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241624:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241629:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241633:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241639:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241644:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241649:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241663:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241668:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241672:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241677:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241682:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241688:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241693:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.241699:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242000:0:16416:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff95f398c7dc00:16416] 1 exiting: rc = 0 00000100:00100000:0.0:1790919712.242333:0:16415:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff95f398c7cc00:16415] 0 exiting: rc = 1 00000100:00100000:0.0:1790919712.242385:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242392:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242398:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242404:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242410:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242416:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242422:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242428:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242434:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242441:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242446:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242451:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242457:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242463:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242468:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242473:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242479:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242484:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242490:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242494:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242500:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242505:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242511:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242516:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242521:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242537:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242543:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242548:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242554:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242559:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242563:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242568:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242573:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242578:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242583:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242588:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242593:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242598:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242603:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242608:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242614:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242619:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242624:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242628:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242633:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242639:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242643:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242649:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242654:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242660:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242664:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242670:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242676:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242681:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242686:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242691:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242696:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242700:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242706:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242711:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242724:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242729:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242735:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919712.242740:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.244178:0:16418:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff95f398c7c400:16418] 1 exiting: rc = 0 00000100:00100000:0.0:1790919712.245297:0:16417:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff95f398c7de00:16417] 0 exiting: rc = 1 00000100:00100000:2.0:1790919712.245875:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245884:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245889:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245894:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245899:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245904:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245909:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245914:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245920:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245925:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245930:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245936:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245941:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245947:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245978:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245983:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245989:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245994:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.245999:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246003:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246008:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246013:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246017:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246030:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246036:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246042:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246047:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246238:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246244:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246250:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246255:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246259:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246264:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246268:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246273:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246278:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246283:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246289:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246293:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246298:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246302:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246307:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246313:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246319:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246325:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246329:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246334:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246339:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246344:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246358:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246363:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246368:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246373:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246378:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246384:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246389:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246394:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246399:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246404:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246408:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246413:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246418:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246423:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.246429:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919712.247538:0:16419:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff95f3bbc8ae00:16419] 0 exiting: rc = 1 00000100:00100000:2.0:1790919712.247835:0:16421:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff95f3bbc8ba00:16421] 2 exiting: rc = 0 00000100:00100000:0.0:1790919712.248425:0:16420:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff95f3bbc8bc00:16420] 1 exiting: rc = 0 00000100:00100000:2.0:1790919712.248544:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248552:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248558:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248563:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248569:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248576:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248582:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248587:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248592:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248599:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248605:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248610:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248617:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248623:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248648:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248655:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248660:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248667:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248673:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248690:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248696:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248702:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248708:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248714:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248719:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248725:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248731:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248736:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248742:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248748:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248754:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248759:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248765:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248770:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248776:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248782:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248788:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248793:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248814:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248821:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248827:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248832:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248838:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248843:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248849:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248855:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248861:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248866:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248872:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248877:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248882:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248888:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248893:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248898:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248911:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248917:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248923:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248928:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248933:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248939:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248945:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248951:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248981:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919712.248989:0:20402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790919712.257312:0:20402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919712.257325:0:20402:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790919712.257329:0:20402:0:(genops.c:885:class_export_put()) final put ffff95f3be274000/MDS_uuid 00000020:00000080:3.0:1790919712.257333:0:20402:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3be274000/MDS_uuid for MDS 00000020:01000000:3.0:1790919712.257344:0:20402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790919712.257648:0:20402:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1790919712.414145:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790919712.735021:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790919712.735031:0:8109:0:(genops.c:885:class_export_put()) final put ffff95f3b4044800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790919712.735090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4044800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790919712.735144:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f285da3000 for lustre-OST0000 00010000:00010000:2.0:1790919713.436237:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919714.460239:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919714.902960:0:20553:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790919714.912416:0:20553:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790919714.912467:0:20553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.912481:0:20553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.912489:0:20553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.912497:0:20553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.912528:0:20553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790919714.912533:0:20553:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1790919714.912667:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919714.912675:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.912683:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919714.912686:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.912695:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919714.912702:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790919714.912732:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919714.912737:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790919714.912743:0:20553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790919714.912749:0:20553:0:(import.c:65:import_set_state_nolock()) ffff95f392715800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790919714.912754:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790919714.912755:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919714.912767:0:20553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790919714.913014:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919714.913018:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790919714.913022:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790919714.913036:0:16394:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:2.0:1790919714.913047:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.913097:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f38166d400/0x951c50ad15914914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591491b expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.913111:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919714.913112:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919714.913114:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919714.913762:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919714.913771:0:20553:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3a0019f80 x1877914978302848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919722 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919714.913788:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790919714.913791:0:20553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790919714.913796:0:20553:0:(import.c:65:import_set_state_nolock()) ffff95f285da2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790919714.913800:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919714.913803:0:20553:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3a0019f80 x1877914978302848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919722 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919714.913810:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919714.913812:0:20553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1790919714.913874:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978302848:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1790919714.915084:0:20553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915099:0:20553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915106:0:20553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915112:0:20553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915140:0:20553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919714.915147:0:20553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915153:0:20553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.915156:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919714.915163:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.915170:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860eec00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919714.915174:0:18447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915181:0:20553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.915182:0:18447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919714.915188:0:20553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919714.915190:0:18447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919714.915195:0:18447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919714.915197:0:18447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1790919714.915204:0:20553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919714.915206:0:18447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 10000000:01000000:0.0:1790919714.915208:0:20553:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790919714.915209:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919714.915212:0:20553:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1790919714.915224:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860eec00/0x951c50ad159148ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159148f1 expref: -99 pid: 17710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790919714.915232:0:20553:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00010000:00010000:2.0:1790919714.915235:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000000:0.0:1790919714.915235:0:20553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790919714.915238:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1790919714.915239:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1790919714.915243:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014800 already unused, calling callback (ffffffffc1a99c20) 00000020:00000080:0.0:1790919714.915244:0:20553:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:2.0:1790919714.915246:0:18447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790919714.915249:0:20553:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff95f284f4cd40) has no exports 00010000:00010000:2.0:1790919714.915253:0:18447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919714.915258:0:18447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919714.915263:0:18447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790919714.915264:0:18447:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790919714.915266:0:18447:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790919714.915270:0:18447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00000020:00080000:0.0:1790919714.915271:0:20553:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff95f284f4cd40) has no exports 00010000:00010000:2.0:1790919714.915273:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.915279:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014800/0x951c50ad15914c4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914c55 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919714.915286:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919714.915287:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919714.915293:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919714.917331:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790919714.917978:0:20553:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f285be9ba0 - data ffff95f38eb3ae58/ffff95f285476000 00000020:01000000:0.0:1790919714.918320:0:20553:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3aed99a20 - data ffff95f3a6c81ca8/ffff95f3a00c6800 00100000:10000000:0.0:1790919714.928261:0:20553:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790919714.965777:0:20553:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159148ff 00000020:00000080:0.0:1790919714.965953:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f3bd7ec000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790919714.966008:0:20553:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f385574800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790919714.966011:0:20553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385574800 2 00000020:01000004:0.0:1790919714.966015:0:20553:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f385574800 from lustre-OST0000 00000020:00000080:0.0:1790919714.966040:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790919714.966087:0:20553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790919714.966090:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f3bd7ee000/lustre-OST0000_UUID 00000020:00000080:0.0:1790919714.966093:0:20553:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bd7ee000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790919714.966102:0:20553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790919714.966164:0:20553:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790919714.966178:0:20553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790919714.966182:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790919714.966187:0:20553:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790919714.966194:0:20553:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95f285da4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790919714.966199:0:20553:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff95f3908a99c0) has exports, disconnecting them 00000020:00080000:0.0:1790919714.966203:0:20553:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95f285da4000), last request at 1790919652 00000020:00000080:0.0:1790919714.966207:0:20553:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914929 00000020:00080000:0.0:1790919714.966216:0:20553:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f285da4000): rc 0 00000020:00000080:0.0:1790919714.966220:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f285da4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790919714.966431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bd7ec000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790919714.966689:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790919714.969165:0:20553:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790919714.969174:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919714.969178:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919714.969184:0:20553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919714.969210:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f392715800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790919714.969362:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919714.969370:0:20553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790919714.969375:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f386d9d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790919714.969379:0:20553:0:(genops.c:844:class_export_destroy()) destroying export ffff95f386d9d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790919714.969385:0:20553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1790919714.969439:0:20553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790919714.969444:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919714.969449:0:20553:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919714.969455:0:20553:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff95f285da2000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919714.969461:0:20553:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff95f285d899c0) has exports, disconnecting them 00000020:00080000:2.0:1790919714.969465:0:20553:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff95f285da2000), last request at 1790919652 00000020:00000080:2.0:1790919714.969469:0:20553:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad1591493e 00000020:00080000:2.0:1790919714.969481:0:20553:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f285da2000): rc 0 00000020:00000080:2.0:1790919714.969485:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f285da2000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790919714.969517:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da2000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1790919715.001669:0:20553:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790919715.001681:0:20553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790919715.001685:0:20553:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790919715.001692:0:20553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919715.001933:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919715.001942:0:20553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1790919715.001948:0:20553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f385574800 1 00000020:00000080:3.0:1790919715.001955:0:20553:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad159148dc 00000020:00000080:3.0:1790919715.001964:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f3b6253800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790919715.001987:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f285da2800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790919715.001996:0:37:0:(genops.c:885:class_export_put()) final put ffff95f285da5000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1790919715.001999:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da5000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1790919715.002010:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:3.0:1790919715.002200:0:20553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790919715.002223:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919715.002228:0:20553:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790919715.002231:0:20553:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff95f3bdfe19c0) has no exports 00000020:00000080:1.0:1790919715.002424:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b6253800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790919715.022819:0:20553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919715.022836:0:20553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790919715.022856:0:20553:0:(genops.c:885:class_export_put()) final put ffff95f3b65b2800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790919715.022861:0:20553:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790919715.022869:0:20553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790919715.023020:0:20553:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f385577000 00000020:02000400:3.0:1790919715.023098:0:20553:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790919715.485004:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919716.188221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919716.188231:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919716.188234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919716.188237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790919716.188242:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919716.188250:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1790919716.188256:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790919716.188278:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f284009800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919716.188320:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae849500 x1877914978302976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919716.188345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790919716.188348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790919716.188350:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919716.188353:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1790919716.188355:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790919716.188359:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff95f3bd7ec800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919716.188368:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae849880 x1877914978303104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919716.188439:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978302976:0@lo:38:kworker.0 00000400:00000100:2.0:1790919716.188493:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978302976 offset 0 length 520: 4 00000100:00100000:2.0:1790919716.188546:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978303104:0@lo:38:kworker.0 00000400:00000100:2.0:1790919716.188572:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877914978303104 offset 0 length 520: 4 00000001:00100000:3.0:1790919716.322831:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790919716.322839:0:9048:0:(genops.c:885:class_export_put()) final put ffff95f285da6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790919716.322895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790919716.322943:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f285da5800 for lustre-OST0001 00010000:00010000:2.0:1790919716.508768:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790919717.272971:0:20704:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790919717.280874:0:20704:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790919717.280972:0:20704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.280989:0:20704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.280999:0:20704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281029:0:20704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281584:0:20704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790919717.281593:0:20704:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1790919717.281696:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919717.281703:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281713:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f2860ee600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919717.281718:0:16395:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281728:0:16395:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919717.281736:0:16395:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919717.281743:0:16395:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919717.281746:0:16395:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790919717.281749:0:16395:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790919717.281765:0:16395:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:1.0:1790919717.281769:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281776:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f2860ee600/0x951c50ad15914a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914a72 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.281800:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919717.281802:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919717.281804:0:16395:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790919717.282350:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919717.282365:0:20704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae849500 x1877914978302976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919717.282383:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790919717.282390:0:20704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790919717.282397:0:20704:0:(import.c:65:import_set_state_nolock()) ffff95f284009800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790919717.282403:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790919717.282407:0:20704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae849500 x1877914978302976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919736 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919717.282414:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790919717.282417:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1790919717.283394:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978302976:0@lo:38:kworker.0 00000100:00080000:0.0:1790919717.285169:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919717.285188:0:20704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae849880 x1877914978303104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919731 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919717.285211:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790919717.285218:0:20704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790919717.285225:0:20704:0:(import.c:65:import_set_state_nolock()) ffff95f3bd7ec800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790919717.285233:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790919717.285238:0:20704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae849880 x1877914978303104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790919731 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919717.285245:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790919717.285248:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1790919717.285280:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978303104:0@lo:38:kworker.0 00010000:00010000:0.0:1790919717.286719:0:20704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286740:0:20704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286745:0:20704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286750:0:20704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286775:0:20704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919717.286782:0:20704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286806:0:20704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286812:0:20704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286818:0:20704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919717.286844:0:20704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790919717.286849:0:20704:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1790919717.286877:0:20704:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1790919717.286892:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919717.286901:0:16394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919717.286908:0:16394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3b6014c00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919717.286912:0:16394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919717.286923:0:16394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.286929:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1790919717.286932:0:16394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.286937:0:18447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919717.286940:0:16394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790919717.286947:0:16394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790919717.286950:0:16394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1790919717.286953:0:18447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696000 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919717.286957:0:18447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.286967:0:18447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919717.286968:0:16394:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:2.0:1790919717.286974:0:16394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919717.286979:0:18447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919717.286989:0:16394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014c00/0x951c50ad15914a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914a48 expref: -99 pid: 18432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1790919717.287001:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:01000000:1.0:1790919717.287007:0:18447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919717.287008:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790919717.287008:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1790919717.287011:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790919717.287013:0:18447:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790919717.287016:0:18447:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:0.0:1790919717.287017:0:20704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:2.0:1790919717.287021:0:16394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790919717.287023:0:20704:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff95f284f499c0) has no exports 00010000:00010000:1.0:1790919717.287025:0:18447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:1.0:1790919717.287031:0:18447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.287039:0:18447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f381696000/0x951c50ad15914c40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad15914c47 expref: -99 pid: 16403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.287093:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919717.287097:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790919717.287099:0:20704:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff95f284f499c0) has no exports 00010000:00010000:1.0:1790919717.287100:0:18447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790919717.289333:0:20704:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3be26d900 - data ffff95f3a6f871b0/ffff95f286f6c400 00000020:01000000:0.0:1790919717.289522:0:20704:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff95f3b5a06540 - data ffff95f3ba6d95e8/ffff95f283b64800 00100000:10000000:0.0:1790919717.297504:0:20704:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790919717.345711:0:20704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a56 00000020:00000080:1.0:1790919717.345721:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f286ff3000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790919717.345740:0:20704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3bd7e8000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790919717.345744:0:20704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3bd7e8000 2 00000020:01000004:1.0:1790919717.345747:0:20704:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff95f3bd7e8000 from lustre-OST0001 00000020:00000080:1.0:1790919717.345773:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919717.345782:0:20704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790919717.345785:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f286ff7000/lustre-OST0001_UUID 00000020:00000080:1.0:1790919717.345788:0:20704:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286ff7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790919717.345795:0:20704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790919717.345874:0:20704:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fb00aa6a-67be-455f-87d9-71f2084f0f0a->MGS 00010000:00010000:1.0:1790919717.345888:0:20704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919717.345900:0:20704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919717.345924:0:20704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790919717.345927:0:20704:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790919717.345930:0:20704:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790919717.345944:0:20704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:1.0:1790919717.345948:0:20704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6015400/0x951c50ad159147a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad159147af expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919717.345962:0:20704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919717.345969:0:20704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919717.345974:0:20704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790919717.345977:0:20704:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790919717.345978:0:20704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790919717.345989:0:20704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95f3be491000 00010000:00010000:1.0:1790919717.345992:0:20704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3b6014a00/0x951c50ad15914697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x951c50ad1591469e expref: -99 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790919717.346007:0:20704:0:(import.c:65:import_set_state_nolock()) ffff95f3be491000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790919717.346011:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790919717.346014:0:20704:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790919717.346015:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790919717.346019:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790919717.346029:0:20704:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95f3ae848a80 x1877914978302080/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790919721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790919717.346095:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790919717.346099:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1790919717.346193:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb00aa6a-67be-455f-87d9-71f2084f0f0a:3457:1877914978302080:0@lo:250:ptlrpcd_00_00.0 00000020:00000080:2.0:1790919717.346199:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286ff3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1790919717.346964:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790919717.346985:0:20704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914682 00000020:00000080:1.0:1790919717.346991:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f3be273800/fb00aa6a-67be-455f-87d9-71f2084f0f0a 00000020:01000000:1.0:1790919717.347009:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.111@tcp (flags='') 00000020:00000080:1.0:1790919717.347015:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919717.347020:0:20704:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790919717.347024:0:20704:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff95f3a68bcd40) has no exports 10000000:01000000:1.0:1790919717.347089:0:16403:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790919717.347151:0:20704:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.111@tcp: client import never connected 00000100:00080000:1.0:1790919717.347154:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790919717.347156:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790919717.347158:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790919717.347161:0:20704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790919717.347203:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790919717.347208:0:20704:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.111@tcp (uuid fb00aa6a-67be-455f-87d9-71f2084f0f0a) 00000020:01000000:1.0:1790919717.347213:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790919717.347216:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790919717.347220:0:20704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790919717.347225:0:20704:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95f285da1800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790919717.347230:0:20704:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff95f284f4b380) has exports, disconnecting them 00000020:00080000:1.0:1790919717.347235:0:20704:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95f285da1800), last request at 1790919664 00000020:00000080:1.0:1790919717.347239:0:20704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a80 00000020:00080000:1.0:1790919717.347249:0:20704:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f285da1800): rc 0 00000020:00000080:1.0:1790919717.347252:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f285da1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790919717.348072:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3be273800/fb00aa6a-67be-455f-87d9-71f2084f0f0a for MGC192.168.203.111@tcp 00000020:00000080:2.0:1790919717.348085:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3be491000 for MGC192.168.203.111@tcp 00000020:00000080:2.0:1790919717.348091:0:477:0:(genops.c:885:class_export_put()) final put ffff95f3aee83000/fb00aa6a-67be-455f-87d9-71f2084f0f0a 00000020:00000080:2.0:1790919717.348094:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3aee83000/fb00aa6a-67be-455f-87d9-71f2084f0f0a for MGC192.168.203.111@tcp 00000020:01000000:2.0:1790919717.348098:0:477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.111@tcp (fb00aa6a-67be-455f-87d9-71f2084f0f0a) 00000020:00000080:2.0:1790919717.348386:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790919717.349181:0:20704:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790919717.349187:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790919717.349190:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790919717.349196:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790919717.349413:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790919717.349421:0:20704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790919717.349427:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790919717.349434:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790919717.349438:0:20704:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790919717.349445:0:20704:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff95f3b4043800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790919717.349453:0:20704:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff95f38d584d40) has exports, disconnecting them 00000020:00080000:2.0:1790919717.349458:0:20704:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff95f3b4043800), last request at 1790919664 00000020:00000080:2.0:1790919717.349462:0:20704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a95 00000020:00080000:2.0:1790919717.349477:0:20704:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95f3b4043800): rc 0 00000020:00000080:2.0:1790919717.349482:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f3b4043800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1790919717.350482:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f284009800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790919717.350501:0:477:0:(genops.c:885:class_export_put()) final put ffff95f286ff5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790919717.350505:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f286ff5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790919717.350534:0:477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790919717.350615:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b4043800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790919717.373134:0:20704:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790919717.373144:0:20704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790919717.373149:0:20704:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790919717.373156:0:20704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790919717.373184:0:477:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95f3bd7ec800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790919717.373240:0:16395:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790919717.374933:0:16394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1790919717.375171:0:18447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790919717.377219:0:16390:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff95f3bb5b4200:16390] 1 exiting: rc = 0 00000100:00100000:3.0:1790919717.378897:0:16389:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95f3bb5b5e00:16389] 0 exiting: rc = 1 00000100:00100000:3.0:1790919717.378989:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.379301:0:16393:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95f394b9d400:16393] 2 exiting: rc = 0 00000100:00100000:2.0:1790919717.380034:0:16392:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff95f3952cca00:16392] 1 exiting: rc = 0 00000100:00100000:0.0:1790919717.380093:0:19148:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95f284ff9800:19148] 3 exiting: rc = 0 00000100:00100000:1.0:1790919717.385415:0:16391:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95f3bb5b4800:16391] 0 exiting: rc = 1 00000100:00100000:3.0:1790919717.386927:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386937:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386943:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386949:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386955:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386976:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386981:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386986:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386992:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.386997:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387014:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387020:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387025:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387038:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387044:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387050:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387073:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387078:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387083:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387088:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387093:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387098:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387102:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387107:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387124:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387130:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387136:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387143:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387148:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387161:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387167:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387172:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387177:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387183:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387188:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387193:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387198:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387203:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387208:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387213:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387225:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387230:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387236:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387242:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387247:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387253:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387259:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387265:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387271:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387276:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387281:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387286:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387291:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387296:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387411:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387421:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387426:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387431:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387437:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387443:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387448:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387453:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387458:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.387464:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790919717.388990:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919717.389081:0:20704:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790919717.389087:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f285da7000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790919717.389092:0:20704:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da7000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790919717.389098:0:20704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790919717.389151:0:20704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3bd7e8000 1 00000020:00000080:3.0:1790919717.389157:0:20704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x951c50ad15914a3a 00000020:00000080:3.0:1790919717.389162:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f285da6800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790919717.389173:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790919717.389184:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff95f285da6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790919717.389288:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919717.389293:0:20704:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790919717.389297:0:20704:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff95f284f48000) has no exports 00000020:00000080:3.0:1790919717.411660:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919717.411674:0:20704:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790919717.411679:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f3bd7ef000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790919717.411684:0:20704:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3bd7ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790919717.411690:0:20704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790919717.411870:0:20704:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff95f3bd7eb000 00000020:01000000:3.0:1790919717.411889:0:20704:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790919717.411892:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790919717.411896:0:20704:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790919717.411900:0:20704:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff95f3bdfe4d40) has no exports 00000020:00000080:3.0:1790919717.411922:0:20704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790919717.411927:0:20704:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790919717.411930:0:20704:0:(genops.c:885:class_export_put()) final put ffff95f3b65b6800/OSS_uuid 00000020:00000080:3.0:1790919717.411932:0:20704:0:(genops.c:844:class_export_destroy()) destroying export ffff95f3b65b6800/OSS_uuid for OSS 00000020:01000000:3.0:1790919717.411935:0:20704:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1790919717.412004:0:17918:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff95f3b6064600:17918] 3 exiting: rc = 0 00000100:00100000:0.0:1790919717.412140:0:17714:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff95f38d4bce00:17714] 2 exiting: rc = 0 00000100:00080000:1.0:1790919717.412220:0:16402:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790919717.413209:0:17711:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff95f3a1876200:17711] 0 exiting: rc = 1 00000100:00100000:3.0:1790919717.414212:0:17712:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff95f38d4bc800:17712] 1 exiting: rc = 0 00000100:00100000:0.0:1790919717.415198:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415209:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415214:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415220:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415226:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415232:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415237:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415256:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415261:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415266:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415271:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415276:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415281:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415286:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415291:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415297:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415302:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415307:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415312:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415318:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415323:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415328:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415334:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415339:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415344:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415349:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415354:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415360:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415364:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415369:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415376:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415383:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415388:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415393:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415399:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415404:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415409:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415414:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415418:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415424:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415429:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415434:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415448:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415454:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415469:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415476:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415481:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415487:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415492:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415497:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415501:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415506:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415710:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415719:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415725:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415731:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415736:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415741:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415747:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415753:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415759:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415764:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415770:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.415775:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.419888:0:17716:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff95f383fb6000:17716] 1 exiting: rc = 0 00000100:00100000:0.0:1790919717.420027:0:17715:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95f38d4bd800:17715] 0 exiting: rc = 1 00000100:00100000:1.0:1790919717.420222:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420229:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420234:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420239:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420247:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420253:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420259:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420278:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420282:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420287:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420292:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420297:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420301:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420307:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420312:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420318:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420323:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420328:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420333:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420338:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420343:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420347:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420352:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420357:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420370:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420377:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420382:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420388:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420392:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420398:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420403:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420408:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420413:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420418:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420423:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420428:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420434:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420438:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420490:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420496:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420502:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420507:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420588:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420593:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420599:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420605:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420615:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420622:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420628:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420633:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420639:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420644:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420650:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420657:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420665:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420670:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420675:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420681:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420686:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420691:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420695:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420701:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420705:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790919717.420710:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.422138:0:17717:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95f386460200:17717] 0 exiting: rc = 1 00000100:00100000:1.0:1790919717.422388:0:17719:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95f38e213600:17719] 2 exiting: rc = 0 00000100:00100000:3.0:1790919717.422776:0:19269:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_004: service thread [ffff95f283aab200:19269] 4 exiting: rc = 0 00000100:00100000:0.0:1790919717.422994:0:19265:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff95f398d87000:19265] 3 exiting: rc = 0 00000100:00100000:1.0:1790919717.423257:0:17718:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95f383fb7a00:17718] 1 exiting: rc = 0 00000100:00100000:0.0:1790919717.423424:0:19270:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_005: service thread [ffff95f385783a00:19270] 5 exiting: rc = 0 00000100:00100000:2.0:1790919717.423723:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423747:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423754:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423759:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423764:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423769:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423775:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423780:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423785:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423790:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423805:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423812:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423817:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423822:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423827:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423832:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423837:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423843:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423848:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423853:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423857:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423863:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423868:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423874:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423884:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423890:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423896:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423901:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423906:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423911:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423916:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423921:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423927:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423932:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423952:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423960:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423972:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423978:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423984:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423989:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.423993:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424000:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424005:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424010:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424015:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424021:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424026:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424032:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424036:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424042:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424047:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424079:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424085:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424091:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424096:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424101:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424107:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424122:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424129:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424134:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424139:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424145:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424152:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.424158:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790919717.427788:0:17720:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff95f3927f1200:17720] 0 exiting: rc = 1 00000100:00100000:1.0:1790919717.427901:0:17721:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff95f3927f0400:17721] 1 exiting: rc = 0 00000100:00100000:2.0:1790919717.427994:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428002:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428007:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428012:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428017:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428027:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428035:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428134:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428141:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428147:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428152:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428157:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428162:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428167:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428172:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428176:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428182:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428187:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428192:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428197:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428202:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428207:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428212:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428217:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428222:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428227:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428233:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428244:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428251:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428256:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428261:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428267:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428272:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428279:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428285:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428290:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428295:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428301:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428306:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428312:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428317:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428324:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428337:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428343:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428350:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428356:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428363:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428368:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428374:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428380:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428386:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428397:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428404:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428410:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428415:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428420:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428424:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428429:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428435:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428440:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428445:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428450:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428455:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.428461:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790919717.429924:0:17722:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff95f2861d3600:17722] 0 exiting: rc = 1 00000100:00100000:1.0:1790919717.430018:0:17723:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95f3be251800:17723] 1 exiting: rc = 0 00000100:00100000:2.0:1790919717.430264:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430273:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430281:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430287:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430293:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430314:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430323:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430329:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430337:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430344:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430349:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430355:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430360:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430375:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430384:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430390:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430397:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430421:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430429:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430436:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430446:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430452:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430458:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430464:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430469:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430476:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430483:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430488:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430495:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430585:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430593:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430599:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430606:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430612:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430618:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430625:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430631:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430637:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430644:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430650:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430656:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430679:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430687:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430693:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430699:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430706:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430712:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430718:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430730:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430737:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430743:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430750:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430756:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430777:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430785:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430790:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430797:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430803:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430810:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430817:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430823:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430830:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430835:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790919717.430842:0:20704:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1790919717.438288:0:20704:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1790919731.868020:0:21422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790919738.345438:0:21886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790919738.345443:0:21886:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790919738.345556:0:21886:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f3b4169000 00000020:01000004:2.0:1790919738.345572:0:21886:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790919738.345580:0:21886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790919738.345595:0:21886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff95f284f48000) 00000020:00000080:2.0:1790919738.345610:0:21886:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790919738.366336:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790919738.369787:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1790919738.371787:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 549: rc = 0 00100000:10000000:2.0:1790919738.372705:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 549: rc = 0 00100000:10000000:2.0:1790919738.373658:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1790919738.373751:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1790919738.374487:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1790919738.374776:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790919738.375738:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 549: rc = 0 00100000:10000000:2.0:1790919738.376131:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 549: rc = 0 00100000:10000000:2.0:1790919738.376763:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 641: rc = 0 00100000:10000000:2.0:1790919738.378717:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 556: rc = 0 00100000:10000000:2.0:1790919738.378881:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 556: rc = 0 00100000:10000000:2.0:1790919738.380648:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 779: rc = 0 00100000:10000000:2.0:1790919738.381770:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919738.383019:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919738.383313:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 779: rc = 0 00100000:10000000:2.0:1790919738.384985:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919738.385906:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 779: rc = 0 00100000:10000000:2.0:1790919738.386876:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 779: rc = 0 00100000:10000000:2.0:1790919738.388009:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919738.388779:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 779: rc = 0 00100000:10000000:2.0:1790919738.389922:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 779: rc = 0 00100000:10000000:2.0:1790919738.390220:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 779: rc = 0 00100000:10000000:3.0:1790919738.395507:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 779: rc = 0 00100000:10000000:3.0:1790919738.396372:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 288: rc = 0 00100000:10000000:3.0:1790919738.398737:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 288: rc = 0 00100000:10000000:3.0:1790919738.400856:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 288: rc = 0 00100000:10000000:3.0:1790919738.405601:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 288: rc = 0 00100000:10000000:3.0:1790919738.405889:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 288: rc = 0 00100000:10000000:3.0:1790919738.406198:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 288: rc = 0 00100000:10000000:3.0:1790919738.406852:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 288: rc = 0 00100000:10000000:3.0:1790919738.408545:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 288: rc = 0 00100000:10000000:3.0:1790919738.408841:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 288: rc = 0 00100000:10000000:3.0:1790919738.409434:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 288: rc = 0 00100000:10000000:3.0:1790919738.409692:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 288: rc = 0 00100000:10000000:3.0:1790919738.409928:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 288: rc = 0 00100000:10000000:3.0:1790919738.415424:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 288: rc = 0 00100000:10000000:3.0:1790919738.415901:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 288: rc = 0 00100000:10000000:3.0:1790919738.417678:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 288: rc = 0 00100000:10000000:3.0:1790919738.417951:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 288: rc = 0 00100000:10000000:3.0:1790919738.418958:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 288: rc = 0 00100000:10000000:3.0:1790919738.420645:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 288: rc = 0 00100000:10000000:3.0:1790919738.420872:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 288: rc = 0 00100000:10000000:3.0:1790919738.421320:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 288: rc = 0 00100000:10000000:3.0:1790919738.421811:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 288: rc = 0 00100000:10000000:3.0:1790919738.422090:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 288: rc = 0 00100000:10000000:3.0:1790919738.422861:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 288: rc = 0 00100000:10000000:3.0:1790919738.423867:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 288: rc = 0 00100000:10000000:2.0:1790919738.425071:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 288: rc = 0 00100000:10000000:2.0:1790919738.425360:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 288: rc = 0 00100000:10000000:2.0:1790919738.425788:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 288: rc = 0 00100000:10000000:2.0:1790919738.426020:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 288: rc = 0 00100000:10000000:2.0:1790919738.427943:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 288: rc = 0 00100000:10000000:2.0:1790919738.428706:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 288: rc = 0 00100000:10000000:2.0:1790919738.428935:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 288: rc = 0 00100000:10000000:2.0:1790919738.429691:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 288: rc = 0 00100000:10000000:2.0:1790919738.430119:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 277: rc = 0 00100000:10000000:2.0:1790919738.430653:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 277: rc = 0 00100000:10000000:2.0:1790919738.432621:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790919738.433027:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 557: rc = 0 00100000:10000000:2.0:1790919738.433487:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790919738.433561:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 557: rc = 0 00100000:10000000:2.0:1790919738.433751:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790919738.433822:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 557: rc = 0 00100000:10000000:2.0:1790919738.434472:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790919738.434700:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 272: rc = 0 00100000:10000000:2.0:1790919738.434888:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790919738.434953:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 272: rc = 0 00100000:10000000:2.0:1790919738.437007:0:21886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790919738.437120:0:21886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 272: rc = 0 00000020:00000080:2.0:1790919738.437650:0:21886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790919738.437657:0:21886:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919738.437666:0:21886:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914f03 00000020:01000004:2.0:1790919738.437673:0:21886:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790919738.437678:0:21886:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790919738.437683:0:21886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3b4169000 from MGS 00000020:01000004:2.0:1790919738.437686:0:21886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790919738.437697:0:21886:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff95f284f4b380) 00000020:00000080:2.0:1790919738.437706:0:21886:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790919738.437753:0:21886:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4169000 from MGS, refs=2 00080000:01000000:2.0:1790919738.437757:0:21886:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919738.437761:0:21886:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914f11 00000100:00100000:2.0:1790919738.437853:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790919738.438007:0:21886:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790919738.438013:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790919738.440273:0:21886:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790919738.440287:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790919738.444028:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790919738.444491:0:21886:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790919738.444497:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790919738.446118:0:21886:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790919738.446129:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790919738.446893:0:21886:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790919738.446906:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790919738.447958:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919738.447970:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919738.447972:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919738.450779:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919738.450784:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919738.450786:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919738.451317:0:21886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790919738.455337:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790919738.472012:0:21886:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790919738.472029:0:21886:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790919738.472032:0:21886:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790919738.476029:0:21895:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790919738.476219:0:21886:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790919738.476321:0:21886:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790919738.477011:0:21886:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790919738.477677:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790919738.478099:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790919738.478105:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790919738.478677:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790919738.478684:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790919738.479165:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790919738.479172:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790919738.480031:0:21886:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790919738.480090:0:21886:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:1.0:1790919738.480092:0:21886:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790919738.480121:0:21886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:1.0:1790919738.480132:0:21886:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (ffff95f38d580000) 00000020:00000080:1.0:1790919738.480144:0:21886:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790919738.480217:0:21886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f286121800@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919738.480367:0:21886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:1.0:1790919738.480374:0:21886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790919738.480642:0:21899:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790919738.486100:0:21900:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790919738.486184:0:21886:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid 0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6) 00000020:00000080:3.0:1790919738.486209:0:21886:0:(genops.c:1384:class_connect()) connect: client 0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6, cookie 0x951c50ad15914f1f 00000100:00080000:3.0:1790919738.486220:0:21886:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919738.486239:0:21886:0:(import.c:666:import_select_connection()) MGC192.168.203.111@tcp: import ffff95f286121800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919738.486273:0:21886:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a0019500 x1877914978303232/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919738.486324:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3457:1877914978303232:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790919738.486388:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790919738.486451:0:21886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6->MGS 00000020:01000004:3.0:1790919738.486476:0:21886:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790919738.486481:0:21886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790919738.486494:0:21886:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff95f285d8b380) 00000020:00000080:3.0:1790919738.486517:0:21886:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790919738.486828:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303232 00000100:00100000:1.0:1790919738.486837:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303232 00000100:00100000:1.0:1790919738.486868:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919738.486877:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3457:x1877914978303232:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790919738.486901:0:21896:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:1.0:1790919738.486925:0:21896:0:(genops.c:1384:class_connect()) connect: client 0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6, cookie 0x951c50ad15914f2d 00000100:00080000:1.0:1790919738.487226:0:21896:0:(import.c:65:import_set_state_nolock()) ffff95f286126800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919738.487317:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+5:3457:x1877914978303232:12345-0@lo:250:mount.lustre.0 Request processed in 439us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.487325:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919738.488601:0:3457:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790919738.488614:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1790919738.488623:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790919738.488629:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790919738.488632:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f286121800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790919738.488635:0:3457:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790919738.488643:0:3457:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790919738.488650:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3457:1877914978303232:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790919738.499693:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919738.500077:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790919738.500324:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790919738.504766:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790919738.504779:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790919738.505708:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919738.505718:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790919738.506894:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919738.507811:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790919738.507818:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790919738.508506:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790919738.508514:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790919738.558241:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790919738.558500:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790919738.558506:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790919738.560043:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790919738.560464:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790919738.561020:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919738.561236:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790919738.561241:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790919738.563404:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790919738.563416:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790919738.564370:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919738.564597:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790919738.564602:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790919738.570880:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790919738.570898:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790919738.571656:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919738.571821:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790919738.571832:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790919738.572459:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790919738.572467:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790919738.591070:0:21886:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919738.591265:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790919738.591271:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790919738.598273:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919738.598294:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790919738.603522:0:21886:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919738.603544:0:21886:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790919738.606268:0:21886:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790919738.606293:0:21886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790919738.606299:0:21886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790919738.606443:0:21886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790919738.606473:0:21886:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790919738.606477:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790919738.606479:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919738.606480:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919738.606481:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919738.606482:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919738.606483:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919738.606485:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919738.606486:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919738.606488:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919738.606489:0:21886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919738.606491:0:21886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790919738.606493:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790919738.606495:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790919738.606496:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790919738.606497:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790919738.606498:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790919738.606499:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790919738.606500:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790919738.606501:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790919738.606502:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790919738.606503:0:21886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790919738.606527:0:21886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790919738.606553:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790919738.606624:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.606670:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391854600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.607019:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303360 00000100:00100000:1.0:1790919738.607034:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303360 00000100:00100000:1.0:1790919738.607190:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919738.607201:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+5:21886:x1877914978303360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919738.607248:0:21898:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790919738.607252:0:21898:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790919738.607255:0:21898:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1790919738.607592:0:21919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790919738.607910:0:21898:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1790919738.610370:0:21920:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790919738.610438:0:21920:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790919738.610442:0:21920:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790919738.610445:0:21920:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790919738.610487:0:21920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1790919738.611020:0:21898:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790919738.611032:0:21898:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790919738.640484:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+5:21886:x1877914978303360:12345-0@lo:253:mount.lustre.0 Request processed in 33277us (33852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919738.640503:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919738.640615:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919738.640631:0:21886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790919738.640634:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919738.640636:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790919738.640637:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919738.640639:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919738.640640:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919738.640641:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919738.640643:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919738.640644:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790919738.640646:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919738.640647:0:21886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790919738.640666:0:21886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3b4169000 from lustre-MDT0000 10000000:01000000:1.0:1790919738.640691:0:21886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790919738.640694:0:21886:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790919738.640699:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff95f38d580000 10000000:01000000:1.0:1790919738.640702:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919738.640710:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff95f38d580000 from 1 10000000:01000000:1.0:1790919738.640712:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790919738.640746:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.640773:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.640783:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.640802:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919738.641377:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.641424:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.643280:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303488 00000100:00100000:2.0:1790919738.643300:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303488 00000100:00100000:2.0:1790919738.643378:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919738.643390:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+5:21886:x1877914978303488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919738.643414:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919738.643443:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1a00/0x951c50ad15914f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914f34 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.643475:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1a00/0x951c50ad15914f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914f34 expref: 6 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.643488:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1a00/0x951c50ad15914f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914f34 expref: 6 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.643498:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1a00, rc 0) 00000100:00100000:2.0:1790919738.643601:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+6:21886:x1877914978303488:12345-0@lo:101:mount.lustre.0 Request processed in 212us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.643609:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919738.643676:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.643702:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.643715:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.643789:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.643854:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.643939:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919738.644586:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303616 00000100:00100000:3.0:1790919738.644595:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303616 00000100:00100000:3.0:1790919738.644756:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919738.644765:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+6:21886:x1877914978303616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919738.645116:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+6:21886:x1877914978303616:12345-0@lo:501:mount.lustre.0 Request processed in 352us (1261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919738.645124:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919738.645592:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303616:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790919738.645635:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790919738.645657:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.645667:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919738.645688:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3b4169000 10000000:01000000:1.0:1790919738.645692:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790919738.645698:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f3b4169000 10000000:01000000:1.0:1790919738.645700:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790919738.645703:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f3b4169000 from 1 10000000:01000000:1.0:1790919738.645705:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790919738.645735:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.645742:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.645751:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.645766:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919738.646080:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.646113:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.646206:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303744 00000100:00100000:0.0:1790919738.646219:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303744 00000100:00100000:0.0:1790919738.646286:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919738.646295:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+6:21886:x1877914978303744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919738.646312:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919738.646332:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3ac6a8400/0x951c50ad15914f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914f42 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.646368:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3ac6a8400/0x951c50ad15914f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914f42 expref: 7 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.646379:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3ac6a8400/0x951c50ad15914f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914f42 expref: 7 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.646388:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3ac6a8400, rc 0) 00000100:00100000:0.0:1790919738.646457:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+7:21886:x1877914978303744:12345-0@lo:101:mount.lustre.0 Request processed in 163us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.646464:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919738.646502:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.646522:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f49 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.646531:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914f49 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919738.646544:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790919738.646561:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f49 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.646577:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c600/0x951c50ad15914f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f49 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919738.646583:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790919738.646587:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919738.646592:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f3b4169000 10000000:01000000:1.0:1790919738.646594:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790919738.646597:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790919738.646599:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919738.646616:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.646724:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.646733:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.646746:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919738.646776:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.646889:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919738.646985:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978303872 00000100:00100000:3.0:1790919738.646992:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978303872 00000100:00100000:3.0:1790919738.647028:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919738.647035:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+7:21886:x1877914978303872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919738.647045:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919738.647079:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c000/0x951c50ad15914f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914f50 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.647098:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c000/0x951c50ad15914f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914f50 expref: 8 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.647108:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c000/0x951c50ad15914f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914f50 expref: 8 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.647127:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c000, rc 0) 00000100:00100000:3.0:1790919738.647213:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+8:21886:x1877914978303872:12345-0@lo:101:mount.lustre.0 Request processed in 170us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919738.647222:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919738.647511:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978303872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.647523:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f57 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.647532:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914f57 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.647589:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.647613:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.647706:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.651772:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304000 00000100:00100000:2.0:1790919738.651793:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304000 00000100:00100000:2.0:1790919738.651970:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919738.651984:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+8:21886:x1877914978304000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.656091:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.656146:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919738.656294:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21886:x1877914978304000:12345-0@lo:501:mount.lustre.0 Request processed in 4312us (8677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.656315:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919738.656459:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.661851:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304128 00000100:00100000:3.0:1790919738.661873:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304128 00000100:00100000:0.0:1790919738.662296:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919738.662309:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21886:x1877914978304128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919738.663157:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21886:x1877914978304128:12345-0@lo:503:mount.lustre.0 Request processed in 846us (6693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.663167:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919738.664115:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.664160:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919738.666424:0:21921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21921:1877914978304256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.666540:0:21921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.666599:0:21921:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.666657:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304256 00000100:00100000:1.0:1790919738.666672:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304256 00000100:00100000:1.0:1790919738.666732:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919738.666742:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21921:x1877914978304256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.667376:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21921:x1877914978304256:12345-0@lo:502:llog_process_th.0 Request processed in 634us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.667385:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790919738.668307:0:21921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21921:1877914978304256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790919738.668365:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919738.668384:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.668386:0:21921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790919738.668402:0:21921:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790919738.668406:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919738.668428:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95f285d8cd40) 00000020:00000080:3.0:1790919738.668454:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790919738.668461:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790919738.668563:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790919738.668572:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914f65 00000020:00000080:3.0:1790919738.668830:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790919738.668835:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919738.668838:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.668840:0:21921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790919738.668843:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919738.668846:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.668848:0:21921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790919738.668851:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919738.668860:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95f285d88000) 00000020:00000080:3.0:1790919738.668871:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790919738.668874:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790919738.668876:0:21921:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790919738.669013:0:21921:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790919738.669042:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790919738.669176:0:21921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4169000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790919738.669198:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95f285d899c0) 00000020:00000080:3.0:1790919738.669213:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790919738.669286:0:21921:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790919738.669294:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914f7a 00000020:00000080:3.0:1790919738.669425:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790919738.669432:0:21921:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790919738.669436:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x951c50ad15914f81 00080000:01000000:2.0:1790919738.670172:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790919738.670294:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914f88 00010000:00010000:2.0:1790919738.735581:0:21921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790919738.740306:0:21921:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1790919738.740567:0:21921:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790919738.741490:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95f284f499c0) 00000020:00000080:2.0:1790919738.741510:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790919738.741571:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790919738.741578:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914f96 00000020:00000080:3.0:1790919738.742539:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790919738.752947:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x951c50ad15914f9d 00000020:00000080:3.0:1790919738.753171:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790919738.753181:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919738.753186:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.753188:0:21921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790919738.753191:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790919738.753194:0:21921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1790919738.753195:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919738.753197:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790919738.753198:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790919738.753200:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.753202:0:21921:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790919738.753204:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919738.753208:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.753210:0:21921:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790919738.753213:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790919738.753245:0:21921:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790919738.753257:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919738.753260:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.753261:0:21921:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790919738.753264:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919738.753268:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919738.753275:0:21921:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790919738.753280:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919738.753285:0:21921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1790919738.753308:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919738.753322:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff95f3908a99c0) 00000020:00000080:3.0:1790919738.753335:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790919738.753340:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919738.753389:0:21921:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790919738.753394:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790919738.753399:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914fab 00010000:00080000:3.0:1790919738.753427:0:21921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f2843bc800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919738.756563:0:21921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1790919738.757817:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919738.757833:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790919738.757864:0:21921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790919738.757884:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914fb2 00000100:00080000:0.0:1790919738.757894:0:21921:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919738.757905:0:21921:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f2843bc800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919738.757939:0:21921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae849500 x1877914978304384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919738.757974:0:21921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1790919738.758029:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.758033:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.758035:0:21921:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790919738.758037:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790919738.758040:0:21921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1790919738.758042:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919738.758044:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919738.758045:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790919738.758048:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.758076:0:21921:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790919738.758080:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790919738.758085:0:21921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790919738.758089:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.758091:0:21921:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790919738.758094:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790919738.758097:0:21921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1790919738.758118:0:21921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790919738.758129:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919738.758142:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff95f3b42b4d40) 00000020:00000080:0.0:1790919738.758154:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790919738.758159:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790919738.758210:0:21921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790919738.758216:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790919738.758220:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914fc0 00010000:00080000:0.0:1790919738.758246:0:21921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3903e3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919738.758447:0:21921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1790919738.759106:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919738.759174:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919738.759307:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304384 00000100:00100000:2.0:1790919738.759316:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304384 00000100:00100000:2.0:1790919738.759347:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919738.759353:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978304384:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1790919738.759369:0:21908:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1790919738.761739:0:21921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790919738.761801:0:21921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790919738.764910:0:21921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919738.766222:0:21921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790919738.766321:0:21921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1790919738.770377:0:21927:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790919738.770385:0:21927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790919738.773388:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919738.773402:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790919738.773438:0:21921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790919738.773457:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914fc7 00000100:00080000:0.0:1790919738.773467:0:21921:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919738.773478:0:21921:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3903e3800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919738.773512:0:21921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae848000 x1877914978304512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919738.773540:0:21921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1790919738.773562:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304512:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790919738.773615:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978304512 offset 0 length 520: 4 00000020:01000000:0.0:1790919738.773623:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.773627:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.773815:0:21921:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790919738.773822:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790919738.773825:0:21921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790919738.773826:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919738.773828:0:21921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919738.773829:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790919738.773843:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.773845:0:21921:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790919738.773848:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790919738.773852:0:21921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790919738.773856:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.773858:0:21921:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790919738.773860:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790919738.773864:0:21921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1790919738.773885:0:21921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790919738.773887:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919738.773898:0:21921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff95f3b42b0000) 00000020:00000080:0.0:1790919738.773910:0:21921:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790919738.773915:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790919738.773986:0:21921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790919738.773992:0:21921:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790919738.773998:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x951c50ad15914fd5 00010000:00080000:0.0:1790919738.774025:0:21921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3903e1000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919738.774246:0:21921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790919738.774433:0:21921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790919738.774454:0:21921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790919738.775137:0:21921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919738.775203:0:21921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790919738.775292:0:21921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1790919738.776267:0:21929:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790919738.776272:0:21929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790919738.777260:0:21921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790919738.777271:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790919738.777304:0:21921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790919738.777323:0:21921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15914fdc 00000100:00080000:0.0:1790919738.777465:0:21921:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919738.777480:0:21921:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919738.777517:0:21921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae849180 x1877914978304640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790919738.777589:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304640:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790919738.777663:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978304640 offset 0 length 520: 4 00000100:00080000:0.0:1790919738.777714:0:21921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790919738.777798:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.777802:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.777804:0:21921:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790919738.777807:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.777811:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.777812:0:21921:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919738.777815:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919738.777817:0:21921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919738.777820:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.777822:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.777823:0:21921:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790919738.777826:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.777828:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.777830:0:21921:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790919738.777833:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790919738.777861:0:21921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21921:1877914978304768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.777911:0:21921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.777930:0:21921:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.778131:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304768 00000100:00100000:0.0:1790919738.778138:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304768 00000100:00100000:0.0:1790919738.778180:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919738.778188:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21921:x1877914978304768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.778498:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21921:x1877914978304768:12345-0@lo:502:llog_process_th.0 Request processed in 309us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.778506:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919738.778559:0:21921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21921:1877914978304768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919738.778583:0:21921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.778592:0:21921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.778594:0:21921:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790919738.778597:0:21921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1790919738.779362:0:21886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1790919738.779386:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790919738.779541:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f57 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.779555:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1d800/0x951c50ad15914f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f57 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919738.779563:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4169000 from 1 10000000:01000000:0.0:1790919738.779566:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919738.779598:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.779606:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.779615:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919738.779633:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919738.779807:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.779873:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.779914:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978304896 00000100:00100000:1.0:1790919738.779921:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978304896 00000100:00100000:1.0:1790919738.779992:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919738.780002:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+9:21886:x1877914978304896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.780014:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919738.780028:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914fe3 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.780078:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 10 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.780112:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 10 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.780120:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1ca00, rc 0) 00000100:00100000:1.0:1790919738.780162:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+10:21886:x1877914978304896:12345-0@lo:101:mount.lustre.0 Request processed in 162us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.780169:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919738.780262:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978304896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919738.780276:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.780285:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919738.780833:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305024:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790919738.780927:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.781312:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.781376:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305024 00000100:00100000:0.0:1790919738.781383:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305024 00000100:00100000:0.0:1790919738.781440:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919738.781448:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+10:21886:x1877914978305024:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790919738.781464:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790919738.781476:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790919738.781836:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+10:21886:x1877914978305024:12345-0@lo:256:mount.lustre.0 Request processed in 387us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.781844:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790919738.781978:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305024:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790919738.782570:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919738.782590:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.782602:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919738.782610:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4169000 from 1 10000000:01000000:3.0:1790919738.782613:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919738.782758:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.782768:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.782778:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919738.782796:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919738.782835:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.782851:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.782916:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305152 00000100:00100000:1.0:1790919738.782922:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305152 00000100:00100000:1.0:1790919738.782954:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919738.782972:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+10:21886:x1877914978305152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.782982:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919738.782995:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914ff1 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.783014:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 11 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.783025:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 11 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.783033:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c400, rc 0) 00000100:00100000:1.0:1790919738.783094:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305152:12345-0@lo:101:mount.lustre.0 Request processed in 133us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.783100:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919738.783244:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919738.783258:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.783281:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919738.783332:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919738.783357:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.783389:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.783489:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305280 00000100:00100000:1.0:1790919738.783493:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305280 00000100:00100000:1.0:1790919738.783531:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919738.783538:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.784046:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305280:12345-0@lo:501:mount.lustre.0 Request processed in 507us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.784084:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790919738.784259:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919738.784295:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919738.784337:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.784395:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.784606:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305408 00000100:00100000:0.0:1790919738.784612:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305408 00000100:00100000:0.0:1790919738.784790:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790919738.784799:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919738.784955:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305408:12345-0@lo:503:mount.lustre.0 Request processed in 157us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.784972:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919738.785073:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919738.788549:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978304384:12345-0@lo:38:llog_process_th.0 Request processed in 29188us (29368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919738.788562:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790919738.788621:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919738.788627:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919738.788645:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919738.790141:0:21931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21931:1877914978305536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.790223:0:21931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.790268:0:21931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.790334:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305536 00000100:00100000:2.0:1790919738.790342:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305536 00000100:00100000:2.0:1790919738.790381:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919738.790390:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21931:x1877914978305536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919738.790874:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21931:x1877914978305536:12345-0@lo:502:llog_process_th.0 Request processed in 483us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.790883:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790919738.791007:0:21931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21931:1877914978305536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919738.791035:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.791044:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791046:0:21931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790919738.791079:0:21931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4169000 00000020:00000080:0.0:1790919738.791082:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919738.791090:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.791093:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791095:0:21931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790919738.791097:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.791099:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791101:0:21931:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790919738.791104:0:21931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4169000 00000020:00000080:0.0:1790919738.791106:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919738.791158:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.791166:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791167:0:21931:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790919738.791170:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.791173:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791174:0:21931:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919738.791178:0:21931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4169000 00000020:00000080:0.0:1790919738.791182:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919738.791200:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.791203:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791204:0:21931:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919738.791206:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919738.791208:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.791210:0:21931:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790919738.791213:0:21931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4169000 00000020:00000080:0.0:1790919738.791215:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790919738.791250:0:21931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21931:1877914978305664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.791288:0:21931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.791311:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305664 00000100:00100000:0.0:1790919738.791315:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305664 00000100:00100000:0.0:1790919738.791339:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919738.791346:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21931:x1877914978305664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.793823:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21931:x1877914978305664:12345-0@lo:502:llog_process_th.0 Request processed in 2471us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.793837:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919738.793914:0:21931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.793935:0:21931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21931:1877914978305664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790919738.793976:0:21931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919738.793984:0:21931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919738.793986:0:21931:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790919738.793990:0:21931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790919738.795256:0:21886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790919738.795287:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919738.795309:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.795323:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919738.795365:0:21886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919738.795369:0:21886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3b4169000 10000000:01000000:3.0:1790919738.795372:0:21886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3b4169000 10000000:01000000:3.0:1790919738.795377:0:21886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919738.795383:0:21886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4169000 from 1 10000000:01000000:3.0:1790919738.795385:0:21886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919738.795417:0:21886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.795438:0:21886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.795449:0:21886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919738.795471:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919738.795523:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919738.801688:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3915339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919738.802166:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305792 00000100:00100000:0.0:1790919738.802176:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305792 00000100:00100000:0.0:1790919738.802265:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919738.802276:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978305792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919738.802293:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919738.802308:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3ac6a8c00/0x951c50ad15915006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15914fff expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.802336:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3ac6a8c00/0x951c50ad15915006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15914fff expref: 12 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.802346:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3ac6a8c00/0x951c50ad15915006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914fff expref: 12 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.802355:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3ac6a8c00, rc 0) 00000100:00100000:0.0:1790919738.802435:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978305792:12345-0@lo:101:mount.lustre.0 Request processed in 160us (6911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.802442:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919738.802517:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919738.802535:0:21886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915006 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919738.802545:0:21886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915006 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.802614:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.802647:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.802887:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.802920:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978305920 00000100:00100000:2.0:1790919738.802925:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978305920 00000100:00100000:2.0:1790919738.802950:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790919738.802966:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978305920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919738.803319:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978305920:12345-0@lo:501:mount.lustre.0 Request processed in 361us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.803328:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790919738.805533:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978305920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919738.805588:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978306048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919738.805662:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.805703:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.806778:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306048 00000100:00100000:2.0:1790919738.806790:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306048 00000100:00100000:2.0:1790919738.807759:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919738.807773:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978306048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919738.808014:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978306048:12345-0@lo:503:mount.lustre.0 Request processed in 246us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.808022:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790919738.812873:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978306048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919738.816375:0:21936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.816455:0:21936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.816496:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306176 00000100:00100000:1.0:1790919738.816502:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306176 00000100:00100000:1.0:1790919738.816553:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919738.816569:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.816969:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306176:12345-0@lo:502:llog_process_th.0 Request processed in 390us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.816978:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790919738.817030:0:21936:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382e57900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.817080:0:21936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306176:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790919738.817154:0:21936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790919738.817170:0:21936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff95f38d583380) 00000020:00000080:1.0:1790919738.817188:0:21936:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1790919738.817257:0:21936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4169000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790919738.817261:0:21936:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3b4169000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790919738.817263:0:21936:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3b4169000 4 00010000:00080000:1.0:1790919738.817300:0:21936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f286ff4000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919738.820610:0:21936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1790919738.820804:0:21936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790919738.820838:0:21936:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919738.820850:0:21936:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x951c50ad15915014 00000100:00080000:1.0:1790919738.820860:0:21936:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919738.820871:0:21936:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95f286ff4000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919738.820905:0:21936:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac3100 x1877914978306304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919738.820929:0:21936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790919738.821111:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978306304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790919738.821177:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919738.821249:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306304 00000100:00100000:2.0:1790919738.821257:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306304 00000100:00100000:2.0:1790919738.821288:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919738.821296:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978306304:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790919738.821348:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978306304:12345-0@lo:38:llog_process_th.0 Request processed in 52us (170us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790919738.821363:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919738.821400:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790919738.821406:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f286ff4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919738.821410:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790919738.821414:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978306304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919738.823420:0:21936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.823494:0:21936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919738.823524:0:21936:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f382c70540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919738.823571:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306432 00000100:00100000:2.0:1790919738.823577:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306432 00000100:00100000:2.0:1790919738.823619:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919738.823628:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790919738.823907:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306432:12345-0@lo:502:llog_process_th.0 Request processed in 280us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.823916:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919738.824760:0:21936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.824882:0:21936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790919738.824931:0:21936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919738.825045:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306560 00000100:00100000:0.0:1790919738.825241:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306560 00000100:00100000:0.0:1790919738.825280:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790919738.825289:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790919738.825451:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21936:x1877914978306560:12345-0@lo:502:llog_process_th.0 Request processed in 162us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.825459:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790919738.825621:0:21936:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3832113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.825637:0:21936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21936:1877914978306560:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790919738.825773:0:21936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790919738.825969:0:21886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790919738.825995:0:21886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790919738.826015:0:21886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915006 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.826026:0:21886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c200/0x951c50ad15914fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915006 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790919738.826104:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790919738.826106:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790919738.826108:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919738.826110:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919738.826111:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919738.826113:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919738.826115:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919738.826117:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790919738.826118:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919738.826124:0:21886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790919738.826128:0:21886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790919738.826131:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919738.826132:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790919738.826134:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919738.826135:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919738.826137:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919738.826138:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919738.826139:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919738.826140:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790919738.826141:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919738.826142:0:21886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790919738.826157:0:21886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790919738.826171:0:21886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978306688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919738.826215:0:21886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919738.826238:0:21886:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919738.826309:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306688 00000100:00100000:1.0:1790919738.826315:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306688 00000100:00100000:1.0:1790919738.826347:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790919738.826355:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21886:x1877914978306688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919738.826377:0:21896:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790919738.826389:0:21896:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790919738.914282:0:21896:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919738.914306:0:21896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790919738.914502:0:21919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919738.914508:0:21919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790919738.914539:0:21919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.914564:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.914574:0:21919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.914627:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.914650:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 12 pid: 21898 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919738.914668:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978306816:0@lo:104: 00000100:00100000:2.0:1790919738.914772:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919738.914901:0:21919:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b300 going to sleep for 11 seconds 00000100:00100000:3.0:1790919738.915046:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306816 00000100:00100000:3.0:1790919738.915085:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306816 00000100:00100000:2.0:1790919738.915302:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790919738.915313:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978306816:12345-0@lo:104: 00010000:00010000:2.0:1790919738.915330:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919738.915404:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919738.915411:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978306816:12345-0@lo:104: Request processed in 100us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919738.915418:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790919738.915428:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919738.915436:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915457:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919738.915462:0:21893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915471:0:21893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919738.915477:0:21893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919738.915484:0:21893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790919738.915529:0:21893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915536:0:21893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919738.915558:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915565:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15914fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914fea expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915585:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919738.915587:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919738.915589:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919738.915617:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978306944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790919738.915634:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978306816:0@lo:104: 00000100:00100000:0.0:1790919738.915652:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919738.915657:0:21919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919738.915835:0:21889:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978306944 00000100:00100000:0.0:1790919738.915841:0:21889:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978306944 00010000:00010000:0.0:1790919738.915863:0:21889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 13 pid: 21898 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919738.915900:0:21889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919738.915908:0:21889:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+13:3459:x1877914978306944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919738.915921:0:21889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919738.915928:0:21889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 13 pid: 21898 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915939:0:21889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 13 pid: 21898 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915954:0:21889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1ca00/0x951c50ad15914fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914fe3 expref: 13 pid: 21898 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.915981:0:21889:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916111:0:21889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790919738.916130:0:21889:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001621584s 00010000:00010000:0.0:1790919738.916134:0:21889:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916142:0:21889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916148:0:21889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916155:0:21889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916167:0:21889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0a00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919738.916171:0:21889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916179:0:21889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916190:0:21889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919738.916200:0:21889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919738.916233:0:21889:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:3459:x1877914978306944:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919738.916239:0:21889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919738.916267:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978306944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919738.916439:0:21919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.916447:0:21919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919738.916454:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a0a00/0x951c50ad1591501b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919738.932898:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21886:x1877914978306688:12345-0@lo:253:mount.lustre.0 Request processed in 106529us (106667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919738.932918:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919738.933075:0:21886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21886:1877914978306688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919738.933168:0:21886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790919738.933172:0:21886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919738.933174:0:21886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790919738.933175:0:21886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919738.933176:0:21886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919738.933177:0:21886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919738.933179:0:21886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919738.933180:0:21886:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790919738.933182:0:21886:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790919738.933184:0:21886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919738.933185:0:21886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790919738.933204:0:21886:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919738.937780:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919738.937969:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919738.939805:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919738.940001:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919738.943734:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919738.943922:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919738.952911:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919738.955789:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919738.957378:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919738.959434:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919738.959831:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919738.961872:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790919739.004743:0:21886:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1790919739.005287:0:21886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790919739.005778:0:21944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1790919739.005862:0:21944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1790919739.006204:0:21886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1790919739.014328:0:21945:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff95f3a001ad80 x1877914978307072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919739.014346:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000040:01000000:0.0:1790919739.015875:0:21886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790919739.016006:0:21886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1790919739.016205:0:21943:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1790919739.016219:0:21943:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:1.0:1790919739.016783:0:21944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790919739.016865:0:21944:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1790919739.017662:0:21886:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790919739.019746:0:21886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790919739.021820:0:21886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919739.026310:0:21886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790919739.028486:0:21886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790919739.028572:0:21886:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790919739.031340:0:21886:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1790919739.033988:0:21886:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1790919739.050692:0:21886:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1790919739.112572:0:21886:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790919739.112611:0:21886:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa204c17bf988 00100000:10000000:2.0:1790919739.112619:0:21886:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790919739.114328:0:21886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919739.114345:0:21886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919739.114467:0:21886:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790919739.114491:0:21886:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1790919739.485561:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919739.741124:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919739.741131:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4169000 from 11 10000000:01000000:2.0:1790919739.741136:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919739.741180:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919739.741193:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919739.741204:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919739.741228:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978307200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919739.741294:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919739.741334:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919739.741434:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307200 00000100:00100000:1.0:1790919739.741443:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307200 00000100:00100000:1.0:1790919739.741495:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790919739.741504:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+11:21900:x1877914978307200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919739.741517:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919739.741531:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915022 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919739.741553:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915022 expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919739.741563:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915022 expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919739.741571:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1da00, rc 0) 00000100:00100000:1.0:1790919739.741614:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21900:x1877914978307200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919739.741621:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919739.741737:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978307200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919739.741752:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919739.741775:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919739.741820:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978307328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919739.741850:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919739.741872:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919739.741992:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307328 00000100:00100000:1.0:1790919739.741997:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307328 00000100:00100000:1.0:1790919739.742025:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790919739.742032:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21900:x1877914978307328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919739.742045:0:21896:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919739.742083:0:21896:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919739.742086:0:21896:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790919739.742160:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:21900:x1877914978307328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919739.742168:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919739.742250:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978307328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919739.742294:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919739.742301:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919739.742310:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919739.870526:0:21937:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790919739.870540:0:21937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919739.875658:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790919739.875702:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790919740.060283:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919740.508278:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919740.896222:0:21937:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790919740.896244:0:21937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790919740.896459:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790919740.896470:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790919741.084256:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919741.536777:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919742.108163:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919742.564843:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919743.134101:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000001:02000400:1.0:1790919743.256998:0:22188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790919743.581518:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790919743.906855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919743.906886:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790919743.906891:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919743.906898:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:0.0:1790919743.906903:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790919743.906915:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f2843bc800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919743.906948:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84ad80 x1877914978307584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919743.906966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919743.906970:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919743.906972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919743.906975:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919743.906977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919743.906980:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790919743.906982:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f286ff4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919743.906986:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95f286ff4000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919743.906994:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84aa00 x1877914978307712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790919743.907023:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978307584:0@lo:38:kworker.0 00000100:00100000:0.0:1790919743.907147:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919743.907197:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978307712:0@lo:38:kworker.0 00000100:00100000:0.0:1790919743.907240:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919743.907296:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307584 00000100:00100000:0.0:1790919743.907303:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307584 00000100:00100000:2.0:1790919743.907422:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978307456:0@lo:400:kworker.0 00000100:00100000:2.0:1790919743.907456:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919743.907490:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307456 00000100:00100000:2.0:1790919743.907494:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307456 00000100:00100000:2.0:1790919743.907577:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919743.907587:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:3460:x1877914978307456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919743.907638:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:3460:x1877914978307456:12345-0@lo:400:kworker.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919743.907644:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919743.907694:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978307456:0@lo:400:kworker.0 00000100:00100000:0.0:1790919743.907746:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919743.907757:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978307584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790919743.907772:0:21909:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790919743.907807:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978307584:12345-0@lo:38:kworker.0 Request processed in 48us (660us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919743.907848:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790919743.907882:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919743.907886:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790919743.907890:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978307584:0@lo:38:kworker.0 00000100:00100000:3.0:1790919743.908119:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307712 00000100:00100000:3.0:1790919743.908124:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307712 00000100:00100000:3.0:1790919743.908148:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919743.908152:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978307712:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790919743.915459:0:21905:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:3.0:1790919743.915524:0:21905:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x951c50ad15915030 00000004:00100000:3.0:1790919743.915543:0:21905:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790919743.915684:0:21905:0:(import.c:65:import_set_state_nolock()) ffff95f2862ee800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919743.915769:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3457:x1877914978307712:12345-0@lo:38:kworker.0 Request processed in 7613us (8526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919743.916007:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790919743.916067:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f3ae84aa00 x1877914978307712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919743.916086:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790919743.916094:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790919743.916099:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919743.916101:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f286ff4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919743.916109:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3457:1877914978307712:0@lo:38:kworker.0 00000100:00100000:0.0:1790919744.164589:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919744.615762:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919745.181989:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790919745.631659:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919746.204112:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919746.652390:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919747.228322:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790919747.680375:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919748.256076:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790919748.705666:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919749.024154:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919738/real 1790919738] req@ffff95f3ae849180 x1877914978304640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919749.024183:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3ae849180 x1877914978304640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919749.024194:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919738/real 1790919738] req@ffff95f3ae848000 x1877914978304512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919749.024206:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3ae848000 x1877914978304512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790919749.024232:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919749.028485:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790919749.028492:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790919749.028495:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919749.028503:0:477:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:1.0:1790919749.028509:0:477:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790919749.028519:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f2843bc800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919749.028534:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978307840:0@lo:400:kworker.0 00000100:00100000:1.0:1790919749.028599:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919749.028666:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307840 00000100:00100000:1.0:1790919749.028673:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307840 00000100:00100000:1.0:1790919749.028710:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919749.028718:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:3461:x1877914978307840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919749.028762:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:3461:x1877914978307840:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919749.028769:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919749.028816:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978307840:0@lo:400:kworker.0 00000100:00100000:1.0:1790919749.028845:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0a80 x1877914978307968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919749.028857:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919749.028861:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919749.028864:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919749.028875:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919749.028878:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919749.028881:0:477:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:1.0:1790919749.028897:0:477:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790919749.028903:0:477:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919749.028917:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac3800 x1877914978308096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919749.028960:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978308224:0@lo:400:kworker.0 00000100:00100000:1.0:1790919749.029089:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919749.029137:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308224 00000100:00100000:1.0:1790919749.029141:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308224 00000100:00100000:1.0:1790919749.029165:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919749.029171:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978308224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919749.029205:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978308224:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919749.029211:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790919749.029245:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f285ac0380 x1877914978308224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919749.029257:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978308224:0@lo:400:kworker.0 00000100:00080000:3.0:1790919749.031836:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919749.031846:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304640:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790919749.031858:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919749.031893:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919749.031898:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790919749.031901:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3903e3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919749.031905:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:0.0:1790919749.031910:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790919749.031941:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3903e3800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919749.031974:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84aa00 x1877914978308352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919749.032418:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919749.032423:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978304512:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790919749.032452:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978307968:0@lo:38:kworker.0 00000100:00100000:3.0:1790919749.032516:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919749.032550:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978308096:0@lo:8:kworker.0 00000400:00000100:3.0:1790919749.032569:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978308096 offset 0 length 520: 4 00000100:00100000:3.0:1790919749.032590:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978308352:0@lo:8:kworker.0 00000400:00000100:3.0:1790919749.032647:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978308352 offset 0 length 520: 4 00000100:00100000:2.0:1790919749.032720:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307968 00000100:00100000:2.0:1790919749.032728:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307968 00000100:00100000:2.0:1790919749.032769:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919749.032776:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978307968:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790919749.032794:0:21908:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790919749.032845:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978307968:12345-0@lo:38:kworker.0 Request processed in 67us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790919749.032852:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790919749.032938:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919749.032943:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790919749.032946:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978307968:0@lo:38:kworker.0 00000100:00100000:1.0:1790919749.280291:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790919749.725232:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790919750.172228:0:21937:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790919750.172235:0:21937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919750.172568:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1790919750.172624:0:21937:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790919750.172658:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000020:01000004:1.0:1790919750.176172:0:22537:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790919750.176177:0:22537:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:1.0:1790919750.176305:0:22537:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f286c1f000 00000020:01000004:1.0:1790919750.176320:0:22537:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1790919750.176332:0:22537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1790919750.176347:0:22537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff95f38d584d40) 00000020:00000080:1.0:1790919750.176364:0:22537:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790919750.191397:0:22537:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790919750.191662:0:22537:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790919750.197757:0:22537:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0x30:0x0] (8/32) 00100000:10000000:1.0:1790919750.199291:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 419: rc = 0 00100000:10000000:1.0:1790919750.199454:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 419: rc = 0 00100000:10000000:1.0:1790919750.199550:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 419: rc = 0 00100000:10000000:1.0:1790919750.201562:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 47: rc = 0 00100000:10000000:1.0:1790919750.201914:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.202326:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 47: rc = 0 00100000:10000000:1.0:1790919750.202576:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.202824:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 47: rc = 0 00100000:10000000:1.0:1790919750.203342:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.203599:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.205027:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 47: rc = 0 00100000:10000000:1.0:1790919750.205396:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.205656:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 47: rc = 0 00100000:10000000:1.0:1790919750.205920:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 47: rc = 0 00100000:10000000:1.0:1790919750.206282:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 47: rc = 0 00100000:10000000:1.0:1790919750.206751:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 68: rc = 0 00100000:10000000:1.0:1790919750.207019:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 68: rc = 0 00100000:10000000:0.0:1790919750.208658:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 68: rc = 0 00100000:10000000:0.0:1790919750.208969:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 68: rc = 0 00100000:10000000:0.0:1790919750.209330:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 68: rc = 0 00100000:10000000:0.0:1790919750.209567:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 68: rc = 0 00100000:10000000:0.0:1790919750.209823:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 68: rc = 0 00100000:10000000:0.0:1790919750.211007:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 68: rc = 0 00100000:10000000:0.0:1790919750.211417:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 68: rc = 0 00100000:10000000:0.0:1790919750.211675:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 68: rc = 0 00100000:10000000:0.0:1790919750.211926:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 68: rc = 0 00100000:10000000:0.0:1790919750.212291:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 68: rc = 0 00100000:10000000:0.0:1790919750.212527:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 68: rc = 0 00100000:10000000:0.0:1790919750.212766:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 68: rc = 0 00100000:10000000:0.0:1790919750.213031:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 68: rc = 0 00100000:10000000:0.0:1790919750.214328:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 68: rc = 0 00100000:10000000:0.0:1790919750.214574:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 68: rc = 0 00100000:10000000:0.0:1790919750.214909:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 68: rc = 0 00100000:10000000:0.0:1790919750.215306:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 68: rc = 0 00100000:10000000:0.0:1790919750.215805:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 68: rc = 0 00100000:10000000:0.0:1790919750.216327:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 68: rc = 0 00100000:10000000:0.0:1790919750.216589:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 68: rc = 0 00100000:10000000:0.0:1790919750.216810:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 68: rc = 0 00100000:10000000:0.0:1790919750.218002:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 68: rc = 0 00100000:10000000:0.0:1790919750.218416:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 68: rc = 0 00100000:10000000:0.0:1790919750.218652:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 68: rc = 0 00100000:10000000:0.0:1790919750.218918:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 68: rc = 0 00100000:10000000:0.0:1790919750.219344:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 68: rc = 0 00100000:10000000:0.0:1790919750.219590:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 68: rc = 0 00100000:10000000:0.0:1790919750.219831:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 68: rc = 0 00100000:10000000:0.0:1790919750.220253:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 68: rc = 0 00100000:10000000:0.0:1790919750.221343:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 68: rc = 0 00100000:10000000:0.0:1790919750.221708:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 61: rc = 0 00100000:10000000:0.0:1790919750.221917:0:22537:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 61: rc = 0 00000020:00000080:0.0:1790919750.222468:0:22537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1790919750.222480:0:22537:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790919750.222490:0:22537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad1591503e 00000020:01000004:0.0:1790919750.222498:0:22537:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:0.0:1790919750.222518:0:22537:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790919750.222521:0:22537:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790919750.222527:0:22537:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1790919750.222545:0:22537:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:0.0:1790919750.222549:0:22537:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1790919750.245415:0:22537:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790919750.245456:0:22537:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1790919750.245460:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790919750.245462:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790919750.245466:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919750.245468:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919750.245469:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919750.245471:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919750.245472:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919750.245474:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919750.245475:0:22537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790919750.245479:0:22537:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1790919750.245481:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790919750.245483:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790919750.245484:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919750.245485:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919750.245486:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919750.245487:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919750.245488:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919750.245489:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919750.245490:0:22537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790919750.245514:0:22537:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790919750.245532:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308480:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790919750.245602:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.245705:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.249239:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308480 00000100:00100000:1.0:1790919750.249255:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308480 00000100:00100000:1.0:1790919750.249420:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790919750.249444:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:22537:x1877914978308480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919750.249492:0:21896:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790919750.249496:0:21896:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1790919750.249502:0:21896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790919750.300823:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000100:00100000:2.0:1790919750.305573:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:22537:x1877914978308480:12345-0@lo:253:mount.lustre.0 Request processed in 56122us (59962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.305589:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919750.311437:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790919750.311462:0:22537:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790919750.311465:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919750.311467:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790919750.311468:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919750.311469:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919750.311471:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919750.311472:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919750.311473:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919750.311475:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919750.311476:0:22537:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790919750.311503:0:22537:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f286c1f000 from lustre-MDT0001 10000000:01000000:0.0:1790919750.311530:0:22537:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790919750.311533:0:22537:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790919750.311541:0:22537:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f38d580000 local copy 00010000:00010000:0.0:1790919750.311551:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919750.311809:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919750.311867:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.311919:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.312033:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308608 00000100:00100000:1.0:1790919750.312040:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308608 00000100:00100000:1.0:1790919750.314181:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919750.314203:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:22537:x1877914978308608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919750.314502:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:22537:x1877914978308608:12345-0@lo:501:mount.lustre.0 Request processed in 309us (2633us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919750.314511:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790919750.314618:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308608:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790919750.314639:0:22537:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790919750.314800:0:22537:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790919750.314810:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.314821:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.314851:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f286c1f000 10000000:01000000:0.0:1790919750.314856:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790919750.314860:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff95f38d580000 10000000:01000000:0.0:1790919750.314863:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790919750.314866:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff95f38d580000 from 1 10000000:01000000:0.0:1790919750.314869:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790919750.314911:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.314920:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.314929:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919750.314960:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919750.314996:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.316347:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919750.318721:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308736 00000100:00100000:2.0:1790919750.318736:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308736 00000100:00100000:2.0:1790919750.318798:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919750.318809:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+12:22537:x1877914978308736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919750.318827:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919750.318847:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1000/0x951c50ad1591504c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915045 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.318888:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1000/0x951c50ad1591504c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915045 expref: 13 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.318901:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1000/0x951c50ad1591504c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915045 expref: 13 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.319267:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1000, rc 0) 00000100:00100000:2.0:1790919750.319430:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+13:22537:x1877914978308736:12345-0@lo:101:mount.lustre.0 Request processed in 622us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.319437:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790919750.319530:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919750.319548:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591504c expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.319557:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591504c expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.319577:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790919750.319635:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591504c expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.319643:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9200/0x951c50ad15915045 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591504c expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.319654:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95f286c1f000 10000000:01000000:0.0:1790919750.319660:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790919750.319664:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95f286c1f000 from 1 10000000:01000000:0.0:1790919750.319667:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790919750.319692:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.319699:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.319708:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919750.319735:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919750.319770:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.319809:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.319851:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308864 00000100:00100000:3.0:1790919750.319857:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308864 00000100:00100000:3.0:1790919750.319904:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919750.319913:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+13:22537:x1877914978308864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919750.319922:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919750.319932:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2dc00/0x951c50ad1591505a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915053 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.319947:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2dc00/0x951c50ad1591505a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915053 expref: 14 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.319956:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2dc00/0x951c50ad1591505a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915053 expref: 14 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.319969:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2dc00, rc 0) 00000100:00100000:3.0:1790919750.320019:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+14:22537:x1877914978308864:12345-0@lo:101:mount.lustre.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.320026:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790919750.320163:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919750.320175:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591505a expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.320183:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591505a expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.320195:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790919750.320210:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591505a expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.320216:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9000/0x951c50ad15915053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591505a expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.320222:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790919750.320225:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790919750.320230:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95f286c1f000 10000000:01000000:0.0:1790919750.320233:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790919750.320236:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790919750.320239:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790919750.320251:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.320259:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.320348:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919750.320362:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919750.320383:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.320406:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.320424:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978308992 00000100:00100000:1.0:1790919750.320429:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978308992 00000100:00100000:1.0:1790919750.320460:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790919750.320468:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+14:22537:x1877914978308992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919750.320475:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919750.320483:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1d400/0x951c50ad15915068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915061 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.320498:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d400/0x951c50ad15915068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915061 expref: 15 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.320505:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1d400/0x951c50ad15915068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915061 expref: 15 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.320512:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d400, rc 0) 00000100:00100000:1.0:1790919750.320552:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978308992:12345-0@lo:101:mount.lustre.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.320564:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919750.321142:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978308992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919750.321156:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915068 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.321164:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915068 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919750.322353:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1790919750.323671:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919750.324592:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790919750.324651:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1790919750.324700:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1790919750.324739:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1790919750.324774:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1790919750.324823:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1790919750.324861:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1790919750.326362:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1790919750.326465:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1790919750.326503:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1790919750.326536:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1790919750.326580:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1790919750.326616:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1790919750.326676:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1790919750.326724:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1790919750.326766:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1790919750.326801:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1790919750.326847:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1790919750.327704:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1790919750.327966:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1790919750.328319:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1790919750.328367:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1790919750.328401:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1790919750.328448:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1790919750.328483:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1790919750.328515:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1790919750.328559:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1790919750.328622:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1790919750.328658:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1790919750.328704:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1790919750.328739:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1790919750.328770:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1790919750.328816:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1790919750.328849:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1790919750.328893:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1790919750.328953:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1790919750.328990:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1790919750.329385:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1790919750.329446:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1790919750.329484:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1790919750.329518:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1790919750.329566:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1790919750.329617:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1790919750.329671:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1790919750.329789:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1790919750.329798:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1790919750.329918:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919750.329985:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.330125:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.330263:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309120 00000100:00100000:1.0:1790919750.330270:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309120 00000100:00100000:1.0:1790919750.330318:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790919750.330327:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919750.330739:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309120:12345-0@lo:501:mount.lustre.0 Request processed in 412us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.330747:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790919750.330855:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919750.330904:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919750.330948:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.330973:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3923a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.331037:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309248 00000100:00100000:3.0:1790919750.331042:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309248 00000100:00100000:3.0:1790919750.331105:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919750.331113:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919750.331394:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309248:12345-0@lo:503:mount.lustre.0 Request processed in 281us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.331400:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919750.332339:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919750.335252:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919750.335342:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919750.335440:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.335488:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919750.335602:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309376 00000100:00100000:0.0:1790919750.335610:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309376 00000100:00100000:0.0:1790919750.335657:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790919750.335667:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919750.336006:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309376:12345-0@lo:502:mount.lustre.0 Request processed in 340us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.336014:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919750.336344:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919750.336755:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790919750.336810:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1790919750.336864:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1790919750.336915:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1790919750.336947:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1790919750.336995:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1790919750.337031:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1790919750.337269:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1790919750.337381:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1790919750.337418:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1790919750.337450:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1790919750.337516:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1790919750.337630:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1790919750.337662:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1790919750.337691:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1790919750.337709:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1790919750.337724:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1790919750.337750:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1790919750.337786:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1790919750.337820:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1790919750.337865:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1790919750.337913:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1790919750.337946:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1790919750.337990:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1790919750.338024:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1790919750.338083:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1790919750.338140:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1790919750.338177:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790919750.338233:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790919750.338285:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790919750.338395:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790919750.338424:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790919750.338466:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790919750.338502:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790919750.338770:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790919750.338827:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790919750.338863:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790919750.338914:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790919750.338964:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790919750.339001:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790919750.339035:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790919750.339194:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790919750.339231:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790919750.339264:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790919750.339442:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919750.339595:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.339705:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.339765:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309504 00000100:00100000:1.0:1790919750.339773:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309504 00000100:00100000:1.0:1790919750.339871:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919750.339891:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919750.340159:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978309504:12345-0@lo:502:mount.lustre.0 Request processed in 269us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.340167:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919750.340255:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978309504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919750.340395:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1790919750.340407:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1790919750.341950:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919750.341963:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.341966:0:22540:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790919750.341971:0:22540:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1790919750.341974:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919750.341989:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff95f284f4cd40) 00000020:00000080:2.0:1790919750.342008:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1790919750.342013:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790919750.342111:0:22540:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790919750.342118:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad15915076 00000020:00000080:2.0:1790919750.342332:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790919750.342336:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919750.342339:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.342341:0:22540:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1790919750.342343:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919750.342347:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.342348:0:22540:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1790919750.342351:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919750.342359:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff95f3bce43380) 00000020:00000080:2.0:1790919750.342369:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1790919750.342372:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790919750.342374:0:22540:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1790919750.342377:0:22540:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1790919750.342382:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790919750.342438:0:22540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f286c1f000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1790919750.342454:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff95f3bce44d40) 00000020:00000080:2.0:1790919750.342463:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1790919750.342508:0:22540:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790919750.342514:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad1591508b 00000020:00000080:2.0:1790919750.342619:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1790919750.342626:0:22540:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790919750.342631:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x951c50ad15915092 00080000:01000000:2.0:1790919750.342636:0:22540:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790919750.342639:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad15915099 00010000:00010000:3.0:1790919750.425231:0:22540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790919750.426353:0:22540:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1790919750.426567:0:22540:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790919750.428916:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790919750.428929:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919750.428935:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.428937:0:22540:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790919750.428941:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919750.428946:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.428948:0:22540:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790919750.428951:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790919750.428957:0:22540:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1790919750.428984:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919750.429000:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff95f3908ab380) 00000020:00000080:3.0:1790919750.429020:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790919750.429025:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790919750.429117:0:22540:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790919750.429124:0:22540:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790919750.429130:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159150a7 00010000:00080000:3.0:1790919750.429168:0:22540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f398dc8800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1790919750.432477:0:22540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1790919750.441010:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790919750.441025:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790919750.441081:0:22540:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790919750.441102:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159150ae 00000100:00080000:1.0:1790919750.441111:0:22540:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919750.441122:0:22540:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff95f398dc8800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919750.441170:0:22540:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0a80 x1877914978309632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919750.441202:0:22540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790919750.441231:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790919750.441236:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790919750.441244:0:477:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919750.441248:0:477:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1790919750.441253:0:477:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790919750.441258:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f2843bc800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919750.441272:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0380 x1877914978309760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919750.441283:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919750.441286:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919750.441289:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919750.441292:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790919750.441325:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978309888:0@lo:400:kworker.0 00000100:00100000:1.0:1790919750.441382:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.441431:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309888 00000100:00100000:1.0:1790919750.441438:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309888 00000100:00100000:1.0:1790919750.441472:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919750.441480:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978309888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919750.441530:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978309888:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.441537:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790919750.442278:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978309632:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790919750.442325:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.442360:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978309760:0@lo:38:kworker.0 00000100:00100000:3.0:1790919750.442383:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.442415:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309632 00000100:00100000:3.0:1790919750.442420:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309632 00000100:00100000:3.0:1790919750.442434:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978309760 00000100:00100000:3.0:1790919750.442436:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978309760 00000100:00100000:3.0:1790919750.442445:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919750.442450:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978309632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790919750.442472:0:21908:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1790919750.442504:0:21908:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159150b5 00000004:00100000:3.0:1790919750.442517:0:21908:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790919750.442523:0:21908:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:0.0:1790919750.445741:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919750.445749:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445752:0:22540:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790919750.445757:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790919750.445761:0:22540:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790919750.445763:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919750.445764:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919750.445766:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790919750.445769:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445770:0:22540:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790919750.445773:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919750.445778:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445780:0:22540:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790919750.445785:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790919750.445835:0:22540:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790919750.445853:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919750.445859:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445867:0:22540:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790919750.445872:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790919750.445886:0:22540:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790919750.445888:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919750.445890:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919750.445892:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790919750.445896:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445898:0:22540:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790919750.445901:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790919750.445904:0:22540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:0.0:1790919750.445909:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919750.445910:0:22540:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790919750.445913:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790919750.445916:0:22540:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1790919750.445945:0:22540:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790919750.445949:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919750.445965:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff95f3b42b19c0) 00000020:00000080:0.0:1790919750.445985:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790919750.446046:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790919750.446277:0:22540:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790919750.446364:0:22540:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790919750.446374:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159150c3 00010000:00080000:0.0:1790919750.446406:0:22540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3bce52800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919750.446795:0:22540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1790919750.447608:0:22540:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790919750.447660:0:22540:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00010000:00080000:1.0:1790919750.447937:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f285ac1880 x1877914978309888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919750.447959:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978309888:0@lo:400:kworker.0 00000040:00080000:0.0:1790919750.450382:0:22540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919750.450495:0:22540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790919750.450640:0:22540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790919750.454311:0:22545:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790919750.454321:0:22545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790919750.456507:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919750.456522:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919750.457435:0:22540:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790919750.457465:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159150ca 00000100:00080000:2.0:1790919750.457477:0:22540:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919750.457489:0:22540:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f3bce52800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919750.457673:0:22540:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4315880 x1877914978310016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919750.457705:0:22540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790919750.457742:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.457747:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919750.457749:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.457752:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1790919750.457812:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919750.457817:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.457820:0:22540:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790919750.457823:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790919750.457832:0:22540:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1790919750.457833:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919750.457835:0:22540:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790919750.457837:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790919750.457839:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.457841:0:22540:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790919750.457843:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790919750.457847:0:22540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1790919750.457850:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.457852:0:22540:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790919750.457854:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790919750.457858:0:22540:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1790919750.457893:0:22540:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790919750.457895:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790919750.457908:0:22540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff95f3bce419c0) 00000020:00000080:2.0:1790919750.458513:0:22540:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790919750.458524:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790919750.458613:0:22540:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790919750.458621:0:22540:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790919750.458628:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x951c50ad159150d8 00010000:00080000:2.0:1790919750.458662:0:22540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f383fae000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919750.458893:0:22540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:3.0:1790919750.459334:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978310016:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790919750.459391:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978310016 offset 0 length 520: 4 00000040:01000000:2.0:1790919750.459673:0:22540:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790919750.459695:0:22540:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790919750.461027:0:22540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919750.461120:0:22540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790919750.461208:0:22540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1790919750.463260:0:22547:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790919750.463267:0:22547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790919750.464754:0:22540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790919750.464769:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790919750.464806:0:22540:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790919750.464826:0:22540:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad159150df 00000100:00080000:2.0:1790919750.464836:0:22540:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919750.464847:0:22540:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f383fae000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919750.464903:0:22540:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4314000 x1877914978310144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919750.464954:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978310144:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790919750.465006:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978310144 offset 0 length 520: 4 00000100:00080000:2.0:1790919750.465078:0:22540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790919750.465101:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.465105:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919750.465108:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.465110:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1790919750.465153:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919750.465158:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.465159:0:22540:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790919750.465162:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919750.465166:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.465167:0:22540:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790919750.465170:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790919750.465173:0:22540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790919750.465175:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919750.465177:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.465179:0:22540:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790919750.465181:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919750.465183:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.465185:0:22540:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790919750.465189:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790919750.465271:0:22540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919750.465276:0:22540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919750.465277:0:22540:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790919750.465282:0:22540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1790919750.465477:0:22537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790919750.465510:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790919750.465525:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915068 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.465536:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a9a00/0x951c50ad15915061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915068 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919750.466458:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f286c1f000 from 1 10000000:01000000:2.0:1790919750.466462:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919750.466494:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.466502:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.466512:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919750.466531:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790919750.467116:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.467152:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.467435:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310272 00000100:00100000:3.0:1790919750.467444:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310272 00000100:00100000:3.0:1790919750.467494:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919750.467503:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+15:22537:x1877914978310272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919750.467518:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919750.467533:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159150e6 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.467567:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159150e6 expref: 16 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.467603:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159150e6 expref: 16 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.467613:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c800, rc 0) 00000100:00100000:3.0:1790919750.467665:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:22537:x1877914978310272:12345-0@lo:101:mount.lustre.0 Request processed in 163us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.467672:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919750.468267:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919750.468285:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.468294:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919750.468846:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310400:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790919750.468924:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.468962:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383211e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.469100:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310400 00000100:00100000:3.0:1790919750.469106:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310400 00000100:00100000:3.0:1790919750.469141:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790919750.469149:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:22537:x1877914978310400:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790919750.469168:0:21898:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790919750.469184:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790919750.469187:0:21898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1790919750.469289:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:22537:x1877914978310400:12345-0@lo:256:mount.lustre.0 Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.469297:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790919750.469348:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310400:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790919750.469958:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790919750.469980:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.469990:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919750.470005:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f286c1f000 from 1 10000000:01000000:0.0:1790919750.470008:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919750.470037:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.470044:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.470073:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919750.470089:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790919750.470125:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.470225:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.472639:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310528 00000100:00100000:3.0:1790919750.472791:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310528 00000100:00100000:3.0:1790919750.472935:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790919750.472947:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:22537:x1877914978310528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919750.472965:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919750.472984:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159150f4 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.473011:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.473042:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919750.473068:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c600, rc 0) 00000100:00100000:3.0:1790919750.473143:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310528:12345-0@lo:101:mount.lustre.0 Request processed in 198us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.473150:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790919750.478644:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919750.478678:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.478691:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790919750.479427:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1790919750.479792:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919750.480115:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790919750.480172:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1790919750.480263:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1790919750.480329:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1790919750.480371:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1790919750.480424:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1790919750.480465:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1790919750.480495:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1790919750.480536:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790919750.480571:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1790919750.480610:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1790919750.480711:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1790919750.480723:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1790919750.480813:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919750.480900:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919750.480941:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919750.481103:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310656 00000100:00100000:2.0:1790919750.481113:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310656 00000100:00100000:2.0:1790919750.481164:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790919750.481173:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919750.481372:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310656:12345-0@lo:501:mount.lustre.0 Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.481380:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919750.482188:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919750.482238:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919750.482297:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.482334:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919750.483586:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310784 00000100:00100000:0.0:1790919750.483598:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310784 00000100:00100000:0.0:1790919750.483684:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790919750.483697:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919750.484686:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919750.485292:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310784:12345-0@lo:503:mount.lustre.0 Request processed in 1595us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.485304:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:1.0:1790919750.485883:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919750.486180:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919750.486249:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.501979:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35840 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.504340:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978310912 00000100:00100000:3.0:1790919750.504355:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978310912 00000100:00100000:3.0:1790919750.504412:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919750.504421:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919750.504722:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978310912:12345-0@lo:502:mount.lustre.0 Request processed in 301us (18472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.504731:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790919750.504997:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978310912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919750.505984:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790919750.506496:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1790919750.506573:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1790919750.506618:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1790919750.506675:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1790919750.513386:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1790919750.513453:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1790919750.513488:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1790919750.513533:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790919750.514503:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1790919750.514634:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1790919750.514736:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919750.514827:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.514889:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919750.514925:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311040 00000100:00100000:3.0:1790919750.514934:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311040 00000100:00100000:3.0:1790919750.514990:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919750.515001:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978311040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919750.515352:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978311040:12345-0@lo:502:mount.lustre.0 Request processed in 352us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.515361:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919750.516835:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919750.517014:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1790919750.517031:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790919750.522337:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919750.522351:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.522353:0:22549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790919750.522363:0:22549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f286c1f000 00000020:00000080:3.0:1790919750.522365:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919750.522387:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919750.522391:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.522392:0:22549:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790919750.522394:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919750.522396:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.522398:0:22549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790919750.522401:0:22549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f286c1f000 00000020:00000080:3.0:1790919750.522402:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919750.522506:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919750.522511:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.522513:0:22549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790919750.522516:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919750.522519:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.522520:0:22549:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919750.522523:0:22549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f286c1f000 00000020:00000080:3.0:1790919750.522525:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919750.530704:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1790919750.531539:0:21908:0:(import.c:65:import_set_state_nolock()) ffff95f3922a2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919750.531653:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978309632:12345-0@lo:38:llog_process_th.0 Request processed in 89198us (89324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.531664:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919750.531692:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790919750.531698:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978309760:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1790919750.531737:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3457:x1877914978309760:12345-0@lo:38:kworker.0 Request processed in 38us (89354us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790919750.531742:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919750.531838:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919750.531848:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790919750.531856:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790919750.531861:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919750.531864:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f398dc8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919750.531888:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978309632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790919750.531900:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919750.531905:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919750.531908:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790919750.531911:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978309760:0@lo:38:kworker.0 00000100:00100000:1.0:1790919750.532229:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978311168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919750.532283:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.532387:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311168 00000100:00100000:3.0:1790919750.532393:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311168 00000100:00100000:3.0:1790919750.532437:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790919750.532445:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978311168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919750.532473:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919750.532520:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3460:x1877914978311168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.532526:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919750.532593:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978311168:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1790919750.534306:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.534314:0:22549:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790919750.534326:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790919750.534334:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.534336:0:22549:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790919750.534342:0:22549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f286c1f000 00000020:00000080:3.0:1790919750.534345:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790919750.534450:0:22549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790919750.534454:0:22549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919750.534456:0:22549:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790919750.534459:0:22549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1790919750.536126:0:22537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790919750.536166:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919750.536183:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536197:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919750.536247:0:22537:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790919750.536250:0:22537:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f286c1f000 10000000:01000000:1.0:1790919750.536253:0:22537:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f286c1f000 10000000:01000000:1.0:1790919750.536267:0:22537:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919750.536273:0:22537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f286c1f000 from 1 10000000:01000000:1.0:1790919750.536276:0:22537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790919750.536310:0:22537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536318:0:22537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536330:0:22537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919750.536352:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919750.536418:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.536461:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311296 00000100:00100000:1.0:1790919750.536467:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311296 00000100:00100000:1.0:1790919750.536511:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790919750.536519:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:22537:x1877914978311296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919750.536532:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919750.536542:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1c800/0x951c50ad15915109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915102 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536575:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1c800/0x951c50ad15915109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915102 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536584:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1c800/0x951c50ad15915109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915102 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536592:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c800, rc 0) 00000100:00100000:1.0:1790919750.536622:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311296:12345-0@lo:101:mount.lustre.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.536633:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790919750.536678:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.536698:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919750.536712:0:22537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915109 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.536720:0:22537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915109 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919750.537580:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1790919750.539897:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790919750.540441:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1790919750.540484:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1790919750.540525:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1790919750.540678:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1790919750.540734:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1790919750.540887:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1790919750.540945:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1790919750.541003:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1790919750.545272:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1790919750.545381:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1790919750.545419:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1790919750.545464:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1790919750.545501:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1790919750.545530:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1790919750.545684:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1790919750.545726:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1790919750.545856:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1790919750.545923:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1790919750.545973:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1790919750.546009:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1790919750.546088:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1790919750.546193:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1790919750.546246:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1790919750.546326:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1790919750.546625:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1790919750.546684:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1790919750.546746:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1790919750.546781:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1790919750.546812:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1790919750.546858:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1790919750.546912:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1790919750.546952:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1790919750.546991:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1790919750.547102:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1790919750.547191:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1790919750.547253:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1790919750.547386:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1790919750.547436:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1790919750.547507:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1790919750.547557:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1790919750.547591:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1790919750.547624:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1790919750.547697:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1790919750.547751:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1790919750.547780:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1790919750.547821:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1790919750.547889:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1790919750.547946:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1790919750.548130:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1790919750.548179:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1790919750.548265:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1790919750.548282:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1790919750.548516:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919750.548596:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.548647:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311424 00000100:00100000:2.0:1790919750.548654:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311424 00000100:00100000:2.0:1790919750.548704:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919750.548714:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919750.548948:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311424:12345-0@lo:501:mount.lustre.0 Request processed in 235us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.548957:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790919750.548999:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790919750.549020:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919750.549084:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919750.549126:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.549145:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f38737b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.550255:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311552 00000100:00100000:1.0:1790919750.550266:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311552 00000100:00100000:1.0:1790919750.550319:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790919750.550329:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919750.550676:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311552:12345-0@lo:503:mount.lustre.0 Request processed in 327us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.550687:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919750.550741:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:3.0:1790919750.551687:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919750.551891:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919750.552280:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.552316:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919750.552435:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311680 00000100:00100000:0.0:1790919750.552444:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311680 00000100:00100000:0.0:1790919750.552493:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919750.552502:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919750.553439:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311680:12345-0@lo:502:mount.lustre.0 Request processed in 934us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.553452:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919750.553730:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919750.554026:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1790919750.554185:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1790919750.554222:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1790919750.555364:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1790919750.555437:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1790919750.555495:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1790919750.555531:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1790919750.555565:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1790919750.555614:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1790919750.555665:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1790919750.555709:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1790919750.555770:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1790919750.555810:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1790919750.555855:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1790919750.555934:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1790919750.556001:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1790919750.556075:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1790919750.556163:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1790919750.556210:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1790919750.556278:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1790919750.559654:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1790919750.559702:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1790919750.559740:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1790919750.559789:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1790919750.559826:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1790919750.559864:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1790919750.559930:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1790919750.559967:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1790919750.560003:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1790919750.560081:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1790919750.560122:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1790919750.560158:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1790919750.560196:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1790919750.560259:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1790919750.560313:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1790919750.560366:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1790919750.560403:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1790919750.560432:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1790919750.560472:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1790919750.560499:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1790919750.560529:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1790919750.560561:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1790919750.560621:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1790919750.560657:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1790919750.560689:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1790919750.560733:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1790919750.560767:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1790919750.560800:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1790919750.564497:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919750.566537:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.566589:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.567243:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311808 00000100:00100000:1.0:1790919750.567254:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311808 00000100:00100000:1.0:1790919750.567299:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919750.567307:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919750.567524:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311808:12345-0@lo:502:mount.lustre.0 Request processed in 216us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.567533:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790919750.567978:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919750.568145:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1790919750.568198:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1790919750.568232:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919750.568279:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.568309:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978311936 00000100:00100000:1.0:1790919750.568314:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978311936 00000100:00100000:1.0:1790919750.568343:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919750.568350:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919750.577181:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978311936:12345-0@lo:502:mount.lustre.0 Request processed in 8821us (8891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.577196:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790919750.577269:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35840 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.577296:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978311936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919750.577477:0:22537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1790919750.577494:0:22537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790919750.581872:0:22556:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1790919750.581900:0:22556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff95f38d5819c0) 00000020:00000080:1.0:1790919750.581924:0:22556:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790919750.582020:0:22556:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f286c1f000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790919750.582024:0:22556:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f286c1f000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790919750.582027:0:22556:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f286c1f000 3 00010000:00080000:1.0:1790919750.582084:0:22556:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f392782000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1790919750.590377:0:22556:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1790919750.590591:0:22556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790919750.590630:0:22556:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790919750.590641:0:22556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x951c50ad15915117 00000100:00080000:1.0:1790919750.590650:0:22556:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790919750.590660:0:22556:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff95f392782000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919750.590697:0:22556:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0e00 x1877914978312064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919750.590751:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978312064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919750.590818:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.593021:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312064 00000100:00100000:1.0:1790919750.593034:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312064 00000100:00100000:1.0:1790919750.593096:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919750.593104:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3457:x1877914978312064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790919750.593132:0:21903:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1790919750.593171:0:21903:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x951c50ad1591511e 00000004:00100000:1.0:1790919750.593187:0:21903:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790919750.593220:0:21903:0:(import.c:65:import_set_state_nolock()) ffff95f392785800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919750.593325:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3457:x1877914978312064:12345-0@lo:38:llog_process_th.0 Request processed in 220us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.593334:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790919750.593392:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f285ac0e00 x1877914978312064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919750.593404:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919750.593413:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790919750.593420:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790919750.593426:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790919750.593428:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f392782000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919750.593434:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3457:1877914978312064:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790919750.593458:0:22556:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790919750.593492:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.593499:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919750.593502:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919750.593505:0:477:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790919750.596799:0:22556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1790919750.597042:0:22537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790919750.597103:0:22537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919750.597218:0:22537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915109 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.597236:0:22537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1dc00/0x951c50ad15915102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915109 expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919750.597483:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919750.597486:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919750.597487:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919750.597488:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919750.597489:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919750.597490:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919750.597492:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919750.597494:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919750.597495:0:22537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919750.597499:0:22537:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1790919750.597502:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919750.597503:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790919750.597504:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919750.597505:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919750.597506:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919750.597507:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919750.597508:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790919750.597509:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919750.597510:0:22537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919750.597539:0:22537:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1790919750.597558:0:22537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978312192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919750.597632:0:22537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.597672:0:22537:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.597698:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312192 00000100:00100000:1.0:1790919750.597706:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312192 00000100:00100000:1.0:1790919750.597748:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790919750.597757:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:22537:x1877914978312192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919750.597794:0:21897:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790919750.597811:0:21897:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790919750.646545:0:21897:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919750.646558:0:21897:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000001:00100000:1.0:1790919750.646588:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790919750.646602:0:21919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790919750.646606:0:21919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790919750.646628:0:21919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646647:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646655:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159150e6 expref: 18 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646663:0:21919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646705:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 18 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646720:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 18 pid: 21896 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919750.646735:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978312320:0@lo:104: 00000100:00100000:1.0:1790919750.646798:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919750.646852:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919750.646861:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919750.646902:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978312448:0@lo:104: 00000100:00100000:1.0:1790919750.646926:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919750.646950:0:21919:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f383d70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919750.647097:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312320 00000100:00100000:0.0:1790919750.647108:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312320 00000100:00100000:0.0:1790919750.647147:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312448 00000100:00100000:0.0:1790919750.647150:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312448 00000100:00100000:0.0:1790919750.647165:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919750.647173:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978312320:12345-0@lo:104: 00010000:00010000:0.0:1790919750.647187:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.647254:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790919750.647262:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978312320:12345-0@lo:104: Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.647269:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919750.647287:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919750.647295:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978312448:12345-0@lo:104: 00000100:00100000:1.0:1790919750.647503:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978312320:0@lo:104: 00010000:00010000:0.0:1790919750.647614:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919750.647704:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790919750.647711:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978312448:12345-0@lo:104: Request processed in 418us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.647718:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919750.647795:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978312448:0@lo:104: 00010000:00010000:1.0:1790919750.647815:0:21919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652168:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919750.652180:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652192:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919750.652196:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652207:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919750.652215:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919750.652222:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919750.652271:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652278:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919750.652327:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652335:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3857a1400/0x951c50ad159150e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150ed expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652349:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919750.652353:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652359:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0400 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919750.652362:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652369:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919750.652375:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919750.652380:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790919750.652398:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652404:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919750.652420:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652426:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3857a0400/0x951c50ad15915022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915029 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652451:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919750.652453:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919750.652455:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919750.652529:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978312576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919750.652604:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.652659:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978312704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919750.652683:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.652733:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312576 00000100:00100000:2.0:1790919750.652740:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312576 00010000:00010000:2.0:1790919750.652766:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 19 pid: 21896 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919750.652789:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312704 00000100:00100000:2.0:1790919750.652793:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312704 00010000:00010000:2.0:1790919750.652803:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 20 pid: 21898 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919750.652817:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919750.652824:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:3461:x1877914978312576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919750.652835:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919750.652840:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 20 pid: 21896 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652851:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 20 pid: 21896 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652865:0:21890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c800/0x951c50ad159150ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159150e6 expref: 20 pid: 21896 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652903:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919750.652936:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:3461:x1877914978312576:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.652943:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919750.652961:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919750.652967:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3458:x1877914978312704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919750.652974:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919750.652979:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652987:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.652997:0:21890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1da00/0x951c50ad15915029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15915022 expref: 18 pid: 21898 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653008:0:21890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653016:0:21890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790919750.653030:0:21890:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006425062s 00010000:00010000:2.0:1790919750.653034:0:21890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653041:0:21890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653089:0:21890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653097:0:21890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653103:0:21890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1d600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919750.653108:0:21890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653117:0:21890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653132:0:21890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653143:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919750.653171:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:3458:x1877914978312704:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.653178:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790919750.653211:0:21919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653220:0:21919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919750.653227:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1d600/0x951c50ad15915125 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919750.653675:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978312704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919750.653717:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978312576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919750.655645:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919750.666433:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:22537:x1877914978312192:12345-0@lo:253:mount.lustre.0 Request processed in 68668us (68792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.666448:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790919750.666464:0:22537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:22537:1877914978312192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790919750.666482:0:22537:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790919750.666485:0:22537:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790919750.666487:0:22537:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790919750.666489:0:22537:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919750.666491:0:22537:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919750.666493:0:22537:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919750.666494:0:22537:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919750.666496:0:22537:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790919750.666498:0:22537:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919750.666500:0:22537:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790919750.666515:0:22537:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790919750.667274:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919750.667451:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919750.667740:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919750.668016:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790919750.668331:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790919750.668474:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919750.670780:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919750.670966:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919750.671941:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919750.672373:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790919750.672795:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:1.0:1790919750.672962:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1790919750.675455:0:22537:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1790919750.675489:0:22561:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790919750.675494:0:22561:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790919750.675785:0:22562:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790919750.675811:0:22537:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1790919750.675856:0:22562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919750.678133:0:22563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978312832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919750.678215:0:22563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.678259:0:22563:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3c00 going to sleep for 11 seconds 00000040:01000000:0.0:1790919750.678504:0:22537:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1790919750.678674:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312832 00000100:00100000:2.0:1790919750.678683:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312832 00000100:00100000:2.0:1790919750.678738:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919750.678747:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978312832:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790919750.678841:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978312832:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919750.678848:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790919750.678904:0:22563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978312832:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1790919750.678935:0:22563:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790919750.678964:0:22563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978312960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790919750.678995:0:22563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.679017:0:22563:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105bcc0 going to sleep for 11 seconds 00000040:00080000:1.0:1790919750.679088:0:22562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790919750.679150:0:22562:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1790919750.679223:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790919750.679767:0:22537:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790919750.679777:0:22537:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1790919750.679921:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919750.680179:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978312960 00000100:00100000:3.0:1790919750.680186:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978312960 00000100:00100000:3.0:1790919750.680221:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919750.680230:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978312960:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919750.680381:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978312960:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 152us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919750.680389:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790919750.680562:0:22563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978312960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790919750.680630:0:22563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22563:1877914978313088:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790919750.680665:0:22563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919750.680695:0:22563:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919750.680921:0:21914:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313088 00000100:00100000:1.0:1790919750.680927:0:21914:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313088 00000100:00100000:1.0:1790919750.680963:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919750.680980:0:21914:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22563:x1877914978313088:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790919750.681035:0:21914:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22563:x1877914978313088:12345-0@lo:900:lod0001_rec0000.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919750.681043:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1790919750.681736:0:22537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:3.0:1790919750.682096:0:22563:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95f3b4315f80 x1877914978313088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919766 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919750.682111:0:22563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22563:1877914978313088:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790919750.682178:0:22563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978313216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790919750.682225:0:22563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919750.682253:0:22563:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919750.682398:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313216 00000100:00100000:0.0:1790919750.682404:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313216 00000040:00080000:1.0:1790919750.682431:0:22537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1790919750.682437:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790919750.682447:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978313216:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1790919750.682468:0:22537:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1790919750.682580:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22563:x1877914978313216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919750.682588:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:1.0:1790919750.682760:0:22537:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919750.682842:0:22563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22563:1877914978313216:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790919750.682897:0:22563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790919750.683749:0:22537:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x31:0x0] (8/8/4) registered 00000040:00080000:3.0:1790919750.685227:0:22563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790919750.685298:0:22563:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790919750.685303:0:22563:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1790919750.688779:0:22537:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1790919750.750929:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790919750.760037:0:22537:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790919750.760096:0:22537:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa204c0d87988 00100000:10000000:1.0:1790919750.760105:0:22537:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790919750.760955:0:22537:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919750.761027:0:22537:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919750.761044:0:22537:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790919750.761110:0:22537:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000100:00100000:1.0:1790919751.324335:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000040:00080000:1.0:1790919751.647844:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790919751.709564:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919751.709577:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f286c1f000 from 12 10000000:01000000:2.0:1790919751.709586:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919751.709673:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.709708:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.709722:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919751.709754:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919751.709847:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919751.709920:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919751.710041:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313344 00000100:00100000:3.0:1790919751.710127:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313344 00000100:00100000:3.0:1790919751.710216:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790919751.710227:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:21900:x1877914978313344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919751.710257:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919751.710281:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591512c expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.710314:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591512c expref: 17 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.710325:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591512c expref: 17 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.710345:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2c400, rc 0) 00000100:00100000:3.0:1790919751.710432:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978313344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919751.710439:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790919751.710510:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919751.710541:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919751.710554:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919751.710636:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790919751.710797:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919751.710845:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790919751.710926:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313472 00000100:00100000:3.0:1790919751.710933:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313472 00000100:00100000:3.0:1790919751.711700:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790919751.711715:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978313472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790919751.711742:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790919751.711764:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790919751.711767:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1790919751.711899:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978313472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919751.711917:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790919751.712351:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919751.712606:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919751.712617:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.712630:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919751.712641:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919751.712644:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4169000 from 12 10000000:01000000:2.0:1790919751.712647:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790919751.713497:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.713512:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.713525:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919751.715843:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919751.715960:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919751.716031:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919751.716129:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313600 00000100:00100000:2.0:1790919751.716140:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313600 00000100:00100000:2.0:1790919751.716203:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790919751.716216:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978313600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919751.716241:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919751.716265:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591513a expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.716300:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591513a expref: 18 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.716314:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591513a expref: 18 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919751.716326:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0c00, rc 0) 00000100:00100000:2.0:1790919751.716909:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978313600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 694us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919751.716920:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790919751.718106:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919751.718142:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.718156:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919751.718261:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790919751.718767:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919751.718820:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919751.720197:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313728 00000100:00100000:0.0:1790919751.720214:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313728 00000100:00100000:0.0:1790919751.720301:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790919751.720313:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978313728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919751.720345:0:21898:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919751.720374:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919751.720378:0:21898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1790919751.720530:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978313728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 218us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919751.720539:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790919751.722031:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978313728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790919751.722132:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790919751.722146:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.722164:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919751.775350:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919752.349668:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000040:00080000:1.0:1790919752.668844:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919752.796639:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919753.372190:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:0.0:1790919753.820303:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919754.396389:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00010000:00010000:2.0:1790919754.845427:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790919755.101407:0:22807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790919755.421117:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 0 seconds 00000100:00100000:1.0:1790919755.677677:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790919755.677703:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978313856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919755.677775:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919755.677938:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313856 00000100:00100000:0.0:1790919755.677949:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313856 00000100:00100000:0.0:1790919755.678016:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919755.678025:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978313856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919755.678086:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919755.678143:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978313856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919755.678151:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919755.678199:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978313856:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1790919755.683047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790919755.683070:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790919755.683074:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919755.683090:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff95f2843bc800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919755.683113:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae849500 x1877914978314112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919755.683132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919755.683135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919755.683138:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919755.683140:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919755.683150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919755.683154:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919755.683157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919755.683160:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790919755.683205:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978314240:0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683267:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919755.683306:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919755.683311:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978313984:0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683340:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919755.683372:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919755.683380:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978314368:0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683409:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919755.683441:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314240 00000100:00100000:0.0:1790919755.683448:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314240 00000100:00100000:0.0:1790919755.683487:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314368 00000100:00100000:0.0:1790919755.683490:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314368 00000100:00100000:0.0:1790919755.683505:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919755.683513:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978314240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683563:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978314240:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919755.683571:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919755.683585:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919755.683591:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978314368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683621:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978314368:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919755.683627:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919755.683651:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978313984 00000100:00100000:0.0:1790919755.683655:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978313984 00000100:00100000:0.0:1790919755.683683:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919755.683691:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3461:x1877914978313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683731:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3461:x1877914978313984:12345-0@lo:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919755.683738:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790919755.683777:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978314112:0@lo:38:kworker.0 00000100:00100000:0.0:1790919755.683801:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790919755.683858:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f3ae849c00 x1877914978314368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919755.683871:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978314368:0@lo:400:kworker.0 00000100:00100000:0.0:1790919755.683892:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978313984:0@lo:400:kworker.0 00010000:00080000:0.0:1790919755.683900:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f3ae84b480 x1877914978314240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919755.683908:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978314240:0@lo:400:kworker.0 00000100:00100000:3.0:1790919755.684510:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314112 00000100:00100000:3.0:1790919755.684517:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314112 00000100:00100000:3.0:1790919755.684560:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790919755.684576:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3457:x1877914978314112:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790919755.684603:0:21909:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:3.0:1790919755.684647:0:21909:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad15915148 00000004:00100000:3.0:1790919755.684663:0:21909:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790919755.684669:0:21909:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1790919755.712808:0:21909:0:(import.c:65:import_set_state_nolock()) ffff95f3922a7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919755.714178:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978314112:12345-0@lo:38:kworker.0 Request processed in 29597us (30370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919755.714192:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1790919755.714817:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1790919755.714828:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790919755.714834:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790919755.714849:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843bc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790919755.714914:0:3457:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000078d08e57): req@ffff95f3a001ad80 x1877914978307072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919755.714940:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978314112:0@lo:38:kworker.0 00000100:00100000:0.0:1790919755.715138:0:21945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919755.715167:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391533d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919755.715250:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978307072 00000100:00100000:1.0:1790919755.715258:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978307072 00000100:00100000:1.0:1790919755.715308:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919755.715317:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978307072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.715411:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978307072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919755.715419:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790919755.715453:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21945:1877914978307072:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1790919755.715486:0:21945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790919755.715525:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21945:1877914978314496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.715557:0:21945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919755.715573:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919755.715583:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314496 00000100:00100000:1.0:1790919755.715587:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314496 00000100:00100000:1.0:1790919755.715601:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919755.715606:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978314496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.715770:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978314496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 162us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919755.715777:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919755.715802:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21945:1877914978314496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.715880:0:21945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21945:1877914978314624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.715906:0:21945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919755.715923:0:21945:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919755.715945:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314624 00000100:00100000:1.0:1790919755.715949:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314624 00000100:00100000:1.0:1790919755.715976:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919755.715982:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978314624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790919755.716040:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21945:x1877914978314624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919755.716046:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919755.716101:0:21945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21945:1877914978314624:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1790919755.716143:0:21945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919755.716567:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978314752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919755.716598:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919755.716778:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314752 00000100:00100000:1.0:1790919755.716783:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314752 00000100:00100000:1.0:1790919755.716804:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919755.716810:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978314752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919755.716851:0:21908:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919755.716894:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978314752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919755.716901:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919755.716932:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978314752:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790919755.718184:0:21945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790919755.718253:0:21945:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 16, retries 0 00000004:00080000:2.0:1790919755.718266:0:21945:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790919755.868923:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919756.901724:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790919757.757567:0:22957:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2f4e4580 20000000:00000080:3.0:1790919757.757592:0:22957:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f3becda800 uarg=0000000000000000 20000000:01000000:3.0:1790919757.757634:0:22957:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790919757.757700:0:22957:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790919757.757707:0:22957:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790919757.759677:0:22958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1790919757.760547:0:22957:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919757.775776:0:22957:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790919757.775903:0:22957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.775941:0:22957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 17 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.775950:0:22957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.776020:0:22957:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.776342:0:22957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.776511:0:22957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919757.776532:0:22957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22957:1877914978314880:0@lo:104: 00000100:00100000:3.0:1790919757.776628:0:22957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790919757.776757:0:22957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 17 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.776767:0:22957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 17 pid: 21898 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919757.776776:0:22957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22957:1877914978315008:0@lo:104: 00000100:00100000:3.0:1790919757.776799:0:22957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919757.776891:0:22957:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285ab69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919757.777268:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978314880 00000100:00100000:0.0:1790919757.777280:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978314880 00000100:00100000:2.0:1790919757.777294:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315008 00000100:00100000:2.0:1790919757.777298:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315008 00000100:00100000:2.0:1790919757.777338:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919757.777348:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:22957:x1877914978315008:12345-0@lo:104: 00010000:00010000:2.0:1790919757.777447:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.777564:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919757.777571:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:22957:x1877914978315008:12345-0@lo:104: Request processed in 225us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919757.777580:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790919757.777596:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790919757.777599:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790919757.777604:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919757.777605:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:22957:x1877914978314880:12345-0@lo:104: 00010000:00010000:2.0:1790919757.777613:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919757.777613:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ce00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919757.777618:0:21893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919757.777641:0:21893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919757.777649:0:21893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919757.777655:0:21893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919757.777659:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919757.777664:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:22957:x1877914978314880:12345-0@lo:104: Request processed in 60us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919757.777670:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790919757.777695:0:21893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919757.777703:0:21893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790919757.777763:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978315136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919757.777788:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790919757.777800:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919757.777859:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919757.777867:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ce00/0x951c50ad15914ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15914ff8 expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919757.777893:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919757.777895:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919757.777897:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919757.778243:0:22957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22957:1877914978315008:0@lo:104: 00000100:00100000:3.0:1790919757.778275:0:22957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22957:1877914978314880:0@lo:104: 00010000:00010000:3.0:1790919757.778304:0:22957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919757.778422:0:21891:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315136 00000100:00100000:2.0:1790919757.778538:0:21891:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315136 00010000:00010000:2.0:1790919757.778566:0:21891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 18 pid: 21898 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919757.778606:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790919757.778614:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3460:x1877914978315136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919757.778628:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919757.778634:0:21891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 18 pid: 21898 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.778644:0:21891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 18 pid: 21898 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.778660:0:21891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1c400/0x951c50ad15914ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15914ff1 expref: 18 pid: 21898 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.778674:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790919757.778686:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919757.778688:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919757.778689:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919757.778720:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919757.778721:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:3460:x1877914978315136:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (920us total) trans 0 rc 0/0 00010000:00010000:3.0:1790919757.778728:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8200 already unused, calling callback (ffffffffc1a99c20) 00000100:00100000:2.0:1790919757.778728:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:00010000:3.0:1790919757.778732:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.778739:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790919757.778754:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919757.778760:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790919757.778795:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.778802:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790919757.778830:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.778838:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8200/0x951c50ad159150f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159150fb expref: -99 pid: 22537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919757.778944:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978315136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919757.778958:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919757.778966:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978315264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919757.778998:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919757.779096:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315264 00000100:00100000:2.0:1790919757.779100:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315264 00010000:00010000:2.0:1790919757.779115:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.779298:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919757.779301:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919757.779303:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919757.779376:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919757.779384:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:3460:x1877914978315264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919757.779395:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919757.779399:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779409:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779428:0:21890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c600/0x951c50ad159150fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159150f4 expref: 17 pid: 21897 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779440:0:21890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779448:0:21890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779463:0:21890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779470:0:21890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779477:0:21890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779485:0:21890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779490:0:21890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919757.779495:0:21890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779504:0:21890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779518:0:21890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.779539:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919757.779572:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:3460:x1877914978315264:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919757.779579:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790919757.779874:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978315264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919757.780167:0:22957:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.780178:0:22957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919757.780185:0:22957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2d800/0x951c50ad1591514f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919757.917073:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919758.940356:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919759.774067:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919759.774074:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f286c1f000 from 13 10000000:01000000:2.0:1790919759.774080:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919759.774128:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774140:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774152:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919759.774179:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919759.774246:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919759.774298:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f395716780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919759.774321:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315392 00000100:00100000:2.0:1790919759.774330:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315392 00000100:00100000:2.0:1790919759.774371:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919759.774381:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+16:21900:x1877914978315392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919759.774395:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919759.774408:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915156 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774432:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915156 expref: 17 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774443:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915156 expref: 17 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774452:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0e00, rc 0) 00000100:00100000:2.0:1790919759.774490:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919759.774497:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790919759.774544:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919759.774559:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919759.774568:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919759.774628:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919759.774654:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919759.774673:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f395716780 going to sleep for 11 seconds 00000100:00100000:0.0:1790919759.777076:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315520 00000100:00100000:0.0:1790919759.777092:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315520 00000100:00100000:0.0:1790919759.777143:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919759.777153:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919759.777449:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919759.777458:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790919759.777514:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919759.777563:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919759.777606:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919759.777647:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919759.777660:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315648 00000100:00100000:0.0:1790919759.777663:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315648 00000100:00100000:0.0:1790919759.777684:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919759.777691:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919759.777836:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919759.777843:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790919759.777877:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919759.778496:0:23071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919759.778544:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919759.778563:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919759.778573:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919759.778584:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919759.778602:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919759.778605:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4169000 from 13 10000000:01000000:0.0:1790919759.778607:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919759.778632:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919759.778640:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919759.778648:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919759.778662:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919759.778697:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919759.778723:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a075c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919759.778771:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315776 00000100:00100000:3.0:1790919759.778777:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315776 00000100:00100000:3.0:1790919759.778818:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790919759.778826:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+17:21900:x1877914978315776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919759.778837:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919759.778848:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915164 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919759.778869:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915164 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919759.778889:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915164 expref: 18 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919759.778898:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3bce2da00, rc 0) 00000100:00100000:3.0:1790919759.778931:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978315776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919759.778937:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790919759.778969:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919759.778980:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919759.778988:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919759.779026:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919759.779063:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919759.779078:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919759.779088:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978315904 00000100:00100000:3.0:1790919759.779091:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978315904 00000100:00100000:3.0:1790919759.779108:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919759.779114:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978315904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919759.779288:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978315904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919759.779295:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790919759.779319:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919759.779351:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978316032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919759.779381:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919759.779392:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391992900 going to sleep for 11 seconds 00000100:00100000:3.0:1790919759.779402:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316032 00000100:00100000:3.0:1790919759.779405:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316032 00000100:00100000:3.0:1790919759.779420:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790919759.779425:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978316032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919759.779536:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:21900:x1877914978316032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919759.780649:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790919759.780715:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978316032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790919759.781394:0:23072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790919759.782030:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790919759.782049:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919759.782074:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919759.782086:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919759.964886:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919760.419187:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1790919760.797044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919760.797067:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919760.797070:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919760.797074:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919760.797100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919760.797104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919760.797106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919760.797109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790919760.797138:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978316288:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797213:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919760.797249:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790919760.797256:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978316160:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797286:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919760.797315:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978316672:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797339:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919760.797377:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978316416:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797401:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919760.797416:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790919760.797421:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978316544:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797441:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919760.797469:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316288 00000100:00100000:2.0:1790919760.797476:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316288 00000100:00100000:2.0:1790919760.797522:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316544 00000100:00100000:2.0:1790919760.797526:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316544 00000100:00100000:2.0:1790919760.797541:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919760.797549:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797605:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3459:x1877914978316288:12345-0@lo:400:kworker.0 Request processed in 56us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919760.797612:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919760.797628:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919760.797634:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797666:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978316544:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919760.797672:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790919760.797706:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978316544:0@lo:400:kworker.0 00000100:00100000:2.0:1790919760.797731:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978316288:0@lo:400:kworker.0 00000100:00100000:0.0:1790919760.797925:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316672 00000100:00100000:0.0:1790919760.797930:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316672 00000100:00100000:0.0:1790919760.797955:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316416 00000100:00100000:0.0:1790919760.797958:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316416 00000100:00100000:0.0:1790919760.797970:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919760.797976:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978316672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919760.798018:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978316672:12345-0@lo:400:kworker.0 Request processed in 42us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919760.798025:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919760.798037:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919760.798043:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978316416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919760.798099:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978316416:12345-0@lo:400:kworker.0 Request processed in 56us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919760.798114:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790919760.798172:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f3b4316a00 x1877914978316416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919760.798183:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978316416:0@lo:400:kworker.0 00010000:00080000:0.0:1790919760.798338:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95f3b4315500 x1877914978316672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919760.798349:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978316672:0@lo:400:kworker.0 00000100:00100000:1.0:1790919760.802095:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919750/real 1790919750] req@ffff95f3b4314000 x1877914978310144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919760 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919760.802128:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3b4314000 x1877914978310144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919760 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919760.802138:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919750/real 1790919750] req@ffff95f3b4315880 x1877914978310016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919760 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919760.802148:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3b4315880 x1877914978310016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919760 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790919760.802188:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383fae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919760.802265:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790919760.802270:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978310144:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790919760.802277:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bce52800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919760.802283:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790919760.802286:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978310016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790919760.803572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919760.803578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919760.803580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919760.803583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919760.803586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919760.803589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790919760.803592:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3bce52800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919760.803599:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:1.0:1790919760.803604:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790919760.803614:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f3bce52800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919760.803636:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0700 x1877914978316928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919760.803653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919760.803656:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919760.803658:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383fae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919760.803661:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:1.0:1790919760.803672:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790919760.803677:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f383fae000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919760.803692:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac1c00 x1877914978317056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919760.803716:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978316928:0@lo:8:kworker.0 00000400:00000100:1.0:1790919760.803765:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978316928 offset 0 length 520: 4 00000100:00100000:1.0:1790919760.803810:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978317056:0@lo:8:kworker.0 00000100:00100000:0.0:1790919760.803958:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919760.803970:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978316800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919760.804007:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1790919760.804463:0:3457:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877914978317056 offset 0 length 520: 4 00000100:00100000:3.0:1790919760.804778:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316160 00000100:00100000:3.0:1790919760.804787:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316160 00000100:00100000:3.0:1790919760.804849:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919760.804859:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3459:x1877914978316160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919760.804917:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:3459:x1877914978316160:12345-0@lo:400:kworker.0 Request processed in 60us (7630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919760.804924:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790919760.804966:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919760.804975:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978317184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919760.805005:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919760.805029:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978316800 00000100:00100000:3.0:1790919760.805033:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978316800 00000100:00100000:3.0:1790919760.805072:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317184 00000100:00100000:3.0:1790919760.805075:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317184 00000100:00100000:3.0:1790919760.805090:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919760.805097:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978316800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919760.805130:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919760.805171:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978316800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919760.805177:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919760.805190:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919760.805195:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978317184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919760.805225:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919760.805252:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978317184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919760.805258:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919760.805291:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978317184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919760.805319:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978316800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919760.805345:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978316160:0@lo:400:kworker.0 00000001:00100000:3.0:1790919760.831011:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790919760.991407:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790919761.825011:0:23208:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790919761.825015:0:23208:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790919761.825370:0:23208:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f3b4511000 00000020:01000004:0.0:1790919761.825385:0:23208:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790919761.825400:0:23208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790919761.825413:0:23208:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95f3b42b3380) 00000020:00000080:0.0:1790919761.825429:0:23208:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790919761.848961:0:23208:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790919761.849418:0:23208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790919761.850478:0:23208:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790919761.851194:0:23208:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790919761.851811:0:23208:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1790919761.852328:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 373: rc = 0 00100000:10000000:1.0:1790919761.852456:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 373: rc = 0 00100000:10000000:1.0:1790919761.852645:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 373: rc = 0 00100000:10000000:1.0:1790919761.853193:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:1.0:1790919761.853438:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:1.0:1790919761.853912:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:1.0:1790919761.854740:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:1.0:1790919761.854982:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:1.0:1790919761.855241:0:23208:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00000020:00000080:1.0:1790919761.855962:0:23208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790919761.855974:0:23208:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790919761.855987:0:23208:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad15915179 00000020:01000004:1.0:1790919761.855995:0:23208:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790919761.856016:0:23208:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790919761.856020:0:23208:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790919761.856026:0:23208:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790919761.856031:0:23208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790919761.856043:0:23208:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff95f3a68bcd40) 00000020:00000080:1.0:1790919761.856147:0:23208:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1790919761.857422:0:23208:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919761.857586:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790919761.857593:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790919761.858935:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790919761.858943:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790919761.861335:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790919761.861355:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790919761.863918:0:23208:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919761.864571:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790919761.864654:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790919761.867332:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790919761.867343:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790919761.887745:0:23208:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790919761.888016:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790919761.888023:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790919761.889604:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790919761.889681:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790919761.890549:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790919761.890558:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790919761.893128:0:23208:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919761.893399:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790919761.893406:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790919761.894183:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790919761.894192:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790919761.925316:0:23208:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790919761.925518:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790919761.925526:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790919761.928736:0:23208:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790919761.928748:0:23208:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790919761.929225:0:23208:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790919761.929249:0:23208:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1790919761.929256:0:23208:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790919761.937257:0:23208:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790919761.937295:0:23208:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1790919761.937304:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790919761.937306:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919761.937307:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919761.937308:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919761.937309:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919761.937310:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919761.937312:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919761.937313:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919761.937314:0:23208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790919761.937318:0:23208:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1790919761.937320:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919761.937322:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919761.937322:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919761.937323:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919761.937324:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919761.937325:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919761.937326:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919761.937327:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919761.937328:0:23208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790919761.937353:0:23208:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790919761.937373:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919761.937449:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919761.937499:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4300 going to sleep for 11 seconds 00000100:00100000:0.0:1790919761.937645:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317312 00000100:00100000:0.0:1790919761.937653:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317312 00000100:00100000:0.0:1790919761.937739:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790919761.937749:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:23208:x1877914978317312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919761.937787:0:21897:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790919761.937799:0:21897:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790919761.937803:0:21897:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790919761.945025:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:23208:x1877914978317312:12345-0@lo:253:mount.lustre.0 Request processed in 7268us (7566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919761.945049:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317312:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790919761.945080:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 10000000:01000000:1.0:1790919761.945088:0:23208:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790919761.945093:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919761.945094:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919761.945096:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919761.945097:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919761.945180:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919761.945182:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919761.945183:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919761.945185:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919761.945187:0:23208:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790919761.945208:0:23208:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f3b4511000 from lustre-OST0000 10000000:01000000:1.0:1790919761.945235:0:23208:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790919761.945238:0:23208:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790919761.945253:0:23208:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f38d580000 local copy 00010000:00010000:1.0:1790919761.945262:0:23208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919761.945629:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919761.945667:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919761.945776:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919761.945846:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317440 00000100:00100000:3.0:1790919761.945854:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317440 00000100:00100000:3.0:1790919761.945903:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790919761.945912:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:23208:x1877914978317440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919761.946101:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:23208:x1877914978317440:12345-0@lo:501:mount.lustre.0 Request processed in 190us (434us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790919761.946109:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790919761.946231:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317440:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790919761.946246:0:23208:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790919761.946391:0:23208:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790919761.946399:0:23208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919761.946408:0:23208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919761.946428:0:23208:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f3b4511000 10000000:01000000:1.0:1790919761.946433:0:23208:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790919761.946438:0:23208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790919761.946440:0:23208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919761.946444:0:23208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790919761.946447:0:23208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790919761.946469:0:23208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919761.946478:0:23208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919761.946487:0:23208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919761.946506:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919761.946659:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919761.946688:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919761.947426:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317568 00000100:00100000:0.0:1790919761.947433:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317568 00000100:00100000:0.0:1790919761.947527:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790919761.947536:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+18:23208:x1877914978317568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919761.947548:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919761.947561:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3ac6a8800/0x951c50ad1591518e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915187 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919761.947584:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3ac6a8800/0x951c50ad1591518e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915187 expref: 19 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919761.947594:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3ac6a8800/0x951c50ad1591518e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915187 expref: 19 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919761.947602:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3ac6a8800, rc 0) 00000100:00100000:0.0:1790919761.947653:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317568:12345-0@lo:101:mount.lustre.0 Request processed in 118us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919761.947668:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790919761.947698:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919761.947712:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591518e expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919761.947721:0:23208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591518e expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919761.948973:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1790919761.952801:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919761.953099:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790919761.953147:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790919761.953185:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790919761.957075:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790919761.957129:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790919761.957166:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790919761.957217:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790919761.957260:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790919761.957324:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1790919761.957381:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1790919761.957419:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1790919761.957472:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1790919761.957551:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1790919761.957560:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1790919761.957664:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919761.957729:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919761.957782:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919761.957873:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317696 00000100:00100000:0.0:1790919761.957882:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317696 00000100:00100000:0.0:1790919761.957932:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790919761.957942:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919761.958718:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317696:12345-0@lo:501:mount.lustre.0 Request processed in 776us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919761.958727:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790919761.960930:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919761.960993:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919761.961086:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919761.961487:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317824 00000100:00100000:0.0:1790919761.961502:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317824 00000100:00100000:1.0:1790919761.961632:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919761.962542:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790919761.962557:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919761.963246:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919761.963461:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317824:12345-0@lo:503:mount.lustre.0 Request processed in 614us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919761.963473:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:0.0:1790919761.967112:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919761.968491:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919761.968583:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919761.968741:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978317952 00000100:00100000:3.0:1790919761.968751:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978317952 00000100:00100000:3.0:1790919761.968861:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790919761.968872:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919761.969154:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978317952:12345-0@lo:502:mount.lustre.0 Request processed in 283us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919761.969163:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790919761.969243:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04480 going to sleep for 11 seconds 00000100:00100000:0.0:1790919761.969265:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978317952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919761.969507:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1790919761.969566:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1790919761.969602:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1790919761.969655:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1790919761.969699:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1790919761.969737:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1790919761.969788:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1790919761.969841:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1790919761.969892:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1790919761.969947:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1790919761.969985:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1790919761.970028:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1790919761.970086:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919761.970129:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919761.970153:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5a04480 going to sleep for 11 seconds 00000100:00100000:3.0:1790919761.970221:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318080 00000100:00100000:3.0:1790919761.970227:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318080 00000100:00100000:3.0:1790919761.970263:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790919761.970272:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978318080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919761.970529:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978318080:12345-0@lo:502:mount.lustre.0 Request processed in 257us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919761.970536:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790919761.970607:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919761.970669:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1790919761.970686:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1790919761.971664:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790919761.971678:0:23222:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790919761.971684:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790919761.971686:0:23222:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790919761.971692:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790919761.971707:0:23222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95f3908acd40) 00000020:00000080:3.0:1790919761.971728:0:23222:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790919761.971733:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790919761.972163:0:23222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4511000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790919761.972172:0:23222:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790919761.972179:0:23222:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x951c50ad1591519c 00010000:00010000:2.0:1790919761.977365:0:23222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1790919761.977850:0:23222:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934606 00080000:10000000:2.0:1790919761.979396:0:23222:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1790919761.994622:0:23222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790919761.994637:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919761.994645:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994647:0:23222:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790919761.994653:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790919761.994656:0:23222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1790919761.994657:0:23222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919761.994659:0:23222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790919761.994661:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790919761.994663:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994665:0:23222:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790919761.994667:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919761.994670:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994671:0:23222:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919761.994674:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919761.994676:0:23222:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919761.994678:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919761.994680:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994681:0:23222:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790919761.994683:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919761.994685:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994687:0:23222:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790919761.994690:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790919761.994764:0:23222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919761.994768:0:23222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919761.994770:0:23222:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790919761.994773:0:23222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1790919761.995021:0:23208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790919761.995047:0:23208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790919761.995099:0:23208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591518e expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919761.995112:0:23208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1de00/0x951c50ad15915187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591518e expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919761.995121:0:23208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4511000 from 1 10000000:01000000:3.0:1790919761.995124:0:23208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919761.995162:0:23208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919761.995170:0:23208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919761.995182:0:23208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919761.995216:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919761.995295:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919761.995346:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919761.995628:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318208 00000100:00100000:2.0:1790919761.995636:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318208 00000100:00100000:2.0:1790919761.995687:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790919761.995696:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978318208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919761.995711:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919761.995725:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159151a3 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919761.995749:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159151a3 expref: 20 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919761.995769:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151a3 expref: 20 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919761.995779:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1200, rc 0) 00000100:00100000:2.0:1790919761.995834:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318208:12345-0@lo:101:mount.lustre.0 Request processed in 139us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919761.995842:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790919761.995944:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919761.995959:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919761.995969:0:23208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919761.996637:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1790919761.996959:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919761.997406:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790919761.997455:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1790919761.997500:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1790919761.997659:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1790919761.997698:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1790919761.997746:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1790919761.997783:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1790919761.997829:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1790919761.997900:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1790919761.997938:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1790919761.997975:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1790919761.998097:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1790919761.998108:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1790919762.000102:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919762.000179:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.000226:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318336 00000100:00100000:3.0:1790919762.000233:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318336 00000100:00100000:3.0:1790919762.000273:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919762.000292:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919762.000516:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318336:12345-0@lo:501:mount.lustre.0 Request processed in 234us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919762.000530:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790919762.000575:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105bd80 going to sleep for 10 seconds 00000100:00100000:3.0:1790919762.000596:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919762.000638:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919762.000678:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.000753:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919762.001363:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318464 00000100:00100000:0.0:1790919762.001370:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318464 00000100:00100000:0.0:1790919762.001398:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790919762.001406:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790919762.001601:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318464:12345-0@lo:503:mount.lustre.0 Request processed in 195us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919762.001615:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790919762.001712:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790919762.002496:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919762.002568:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919762.002627:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.002675:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919762.002826:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318592 00000100:00100000:2.0:1790919762.002833:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318592 00000100:00100000:2.0:1790919762.002863:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790919762.002872:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919762.003493:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318592:12345-0@lo:502:mount.lustre.0 Request processed in 621us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919762.003502:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790919762.004214:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919762.004556:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790919762.004620:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790919762.004672:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790919762.004706:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790919762.004738:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790919762.005218:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790919762.005278:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790919762.005377:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790919762.005452:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790919762.005495:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790919762.005541:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790919762.005583:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919762.005649:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919762.005903:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3ac58ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919762.008217:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318720 00000100:00100000:0.0:1790919762.008228:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318720 00000100:00100000:2.0:1790919762.008386:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790919762.008397:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919762.008658:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318720:12345-0@lo:502:mount.lustre.0 Request processed in 263us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919762.008667:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790919762.008753:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919762.008906:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1790919762.008921:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790919762.010321:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919762.010332:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.010335:0:23226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790919762.010343:0:23226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4511000 00000020:00000080:0.0:1790919762.010345:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919762.010351:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919762.010354:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.010355:0:23226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790919762.010357:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919762.010360:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.010361:0:23226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790919762.010364:0:23226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f3b4511000 00000020:00000080:0.0:1790919762.010365:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919762.010593:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919762.010598:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.010600:0:23226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790919762.010603:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919762.010607:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.010609:0:23226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919762.010613:0:23226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4511000 00000020:00000080:0.0:1790919762.010615:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919762.016591:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919762.016615:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.016622:0:23226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790919762.016629:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919762.016633:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.016635:0:23226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790919762.016640:0:23226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f3b4511000 00000020:00000080:0.0:1790919762.016642:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790919762.016738:0:23226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919762.016742:0:23226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919762.016744:0:23226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790919762.016747:0:23226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00010000:00010000:0.0:1790919762.019892:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790919762.022327:0:23208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790919762.022368:0:23208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919762.022870:0:23208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919762.022884:0:23208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919762.022934:0:23208:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790919762.022937:0:23208:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f3b4511000 10000000:01000000:3.0:1790919762.022940:0:23208:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f3b4511000 10000000:01000000:3.0:1790919762.022944:0:23208:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790919762.022950:0:23208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f3b4511000 from 1 10000000:01000000:3.0:1790919762.022953:0:23208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790919762.022988:0:23208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919762.023004:0:23208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919762.023016:0:23208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919762.023039:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919762.023118:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.023160:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919762.023431:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318848 00000100:00100000:2.0:1790919762.023439:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318848 00000100:00100000:2.0:1790919762.023484:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790919762.023493:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:23208:x1877914978318848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919762.023506:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919762.023518:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0800/0x951c50ad159151b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159151b1 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.023538:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0800/0x951c50ad159151b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159151b1 expref: 21 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.023548:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0800/0x951c50ad159151b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151b1 expref: 21 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.023556:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0800, rc 0) 00000100:00100000:2.0:1790919762.023594:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978318848:12345-0@lo:101:mount.lustre.0 Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919762.023600:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790919762.024888:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919762.024907:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151b8 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919762.024918:0:23208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159151b8 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919762.025544:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1790919762.025838:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919762.026116:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1790919762.026162:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1790919762.026198:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1790919762.026251:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1790919762.026292:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1790919762.026343:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1790919762.026382:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1790919762.026417:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1790919762.026487:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1790919762.026528:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1790919762.026578:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1790919762.026630:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1790919762.031427:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1790919762.031534:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1790919762.031635:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1790919762.031698:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1790919762.031747:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1790919762.032654:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1790919762.032709:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1790919762.032748:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1790919762.032815:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1790919762.032855:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1790919762.032891:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1790919762.032944:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1790919762.033003:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1790919762.033041:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1790919762.033183:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1790919762.033222:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1790919762.033257:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1790919762.033305:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1790919762.033341:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1790919762.033375:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1790919762.033409:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1790919762.033459:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1790919762.033497:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1790919762.033550:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1790919762.033588:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1790919762.033625:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1790919762.033683:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1790919762.033727:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1790919762.033776:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1790919762.033820:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1790919762.033863:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1790919762.033903:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1790919762.033929:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1790919762.033973:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1790919762.034007:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1790919762.034039:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1790919762.034161:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1790919762.034197:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1790919762.034262:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1790919762.034271:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1790919762.034372:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919762.034435:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.034724:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b600 going to sleep for 11 seconds 00000100:00100000:2.0:1790919762.034780:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978318976 00000100:00100000:2.0:1790919762.034798:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978318976 00000100:00100000:2.0:1790919762.034885:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790919762.034894:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978318976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919762.035146:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978318976:12345-0@lo:501:mount.lustre.0 Request processed in 252us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919762.035154:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790919762.035243:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978318976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919762.035276:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919762.035315:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.035340:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919762.035395:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319104 00000100:00100000:1.0:1790919762.035400:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319104 00000100:00100000:1.0:1790919762.035432:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790919762.035439:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919762.035708:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319104:12345-0@lo:503:mount.lustre.0 Request processed in 269us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.035715:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790919762.035815:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790919762.036326:0:23208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790919762.036380:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919762.036420:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.036448:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919762.036666:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319232 00000100:00100000:1.0:1790919762.036672:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319232 00000100:00100000:1.0:1790919762.036695:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790919762.036702:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919762.036949:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319232:12345-0@lo:502:mount.lustre.0 Request processed in 247us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.036957:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790919762.037039:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790919762.037279:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1790919762.037336:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1790919762.037373:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1790919762.037421:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1790919762.037458:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1790919762.037522:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1790919762.037561:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1790919762.037598:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1790919762.037650:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1790919762.037689:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1790919762.037742:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1790919762.037802:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1790919762.037837:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1790919762.037869:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1790919762.037928:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1790919762.037968:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1790919762.037998:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1790919762.038711:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1790919762.038763:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1790919762.038821:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1790919762.038889:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1790919762.038943:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1790919762.038996:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1790919762.040304:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1790919762.040367:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1790919762.040403:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1790919762.040453:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1790919762.040492:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1790919762.040529:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1790919762.040581:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1790919762.040618:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1790919762.040650:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1790919762.040687:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1790919762.040756:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1790919762.040848:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1790919762.040904:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1790919762.040943:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1790919762.040980:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1790919762.041046:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1790919762.041206:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1790919762.041263:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1790919762.041310:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1790919762.041365:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1790919762.041407:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1790919762.041448:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1790919762.041501:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1790919762.041540:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1790919762.041575:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1790919762.041644:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919762.041717:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.041975:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790919762.042024:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319360 00000100:00100000:1.0:1790919762.042033:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319360 00000100:00100000:1.0:1790919762.042316:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790919762.042326:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919762.042560:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319360:12345-0@lo:502:mount.lustre.0 Request processed in 235us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.042576:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790919762.042663:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919762.042773:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1790919762.042833:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1790919762.042867:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919762.042908:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919762.042941:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3921a9000 going to sleep for 11 seconds 00000100:00100000:3.0:1790919762.043016:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319488 00000100:00100000:3.0:1790919762.043022:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319488 00000100:00100000:3.0:1790919762.043083:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790919762.043092:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790919762.043228:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978319488:12345-0@lo:502:mount.lustre.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919762.043235:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790919762.043388:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978319488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919762.043475:0:23208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1790919762.043488:0:23208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790919762.044561:0:23232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790919762.044578:0:23232:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95f3bce40000) 00000020:00000080:2.0:1790919762.044600:0:23232:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1790919762.044690:0:23232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4511000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790919762.044694:0:23232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3b4511000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790919762.044698:0:23232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3b4511000 3 00010000:00080000:2.0:1790919762.044732:0:23232:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f286ff7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1790919762.049603:0:23232:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1790919762.050027:0:23232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790919762.050082:0:23232:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790919762.050093:0:23232:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x951c50ad159151c6 00000100:00080000:2.0:1790919762.050102:0:23232:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790919762.050113:0:23232:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff95f286ff7000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919762.050152:0:23232:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4316300 x1877914978319616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919762.050183:0:23232:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790919762.050813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.050818:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.050820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.050823:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.050846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.050849:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.050852:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.050860:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790919762.050953:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978319744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051013:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.051045:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790919762.051074:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978320128:0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051102:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919762.051135:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978319872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051164:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919762.051172:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320128 00000100:00100000:3.0:1790919762.051180:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919762.051180:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320128 00000100:00100000:3.0:1790919762.051185:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978320000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919762.051213:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319872 00000100:00100000:0.0:1790919762.051216:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319872 00000100:00100000:0.0:1790919762.051232:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919762.051240:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978320128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919762.051300:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3461:x1877914978320128:12345-0@lo:400:kworker.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919762.051307:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790919762.051322:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790919762.051328:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978319872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919762.051356:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3458:x1877914978319872:12345-0@lo:400:kworker.0 Request processed in 28us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919762.051362:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919762.051394:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790919762.051397:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3a0018380 x1877914978320128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919762.051410:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3461:1877914978320128:0@lo:400:kworker.0 00010000:00080000:3.0:1790919762.051415:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3a001bb80 x1877914978319872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919762.051423:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3458:1877914978319872:0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051447:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319744 00000100:00100000:3.0:1790919762.051451:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319744 00000100:00100000:3.0:1790919762.051468:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320000 00000100:00100000:3.0:1790919762.051470:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320000 00000100:00100000:3.0:1790919762.051482:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919762.051487:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978319744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051524:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978319744:12345-0@lo:400:kworker.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919762.051530:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919762.051543:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790919762.051548:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978320000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919762.051590:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978320000:12345-0@lo:400:kworker.0 Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919762.051597:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790919762.051728:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978320000:0@lo:400:kworker.0 00000100:00100000:0.0:1790919762.052888:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978319744:0@lo:400:kworker.0 00000100:00100000:1.0:1790919762.053179:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978319616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919762.053226:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1790919762.053490:0:23232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790919762.053505:0:23232:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff95f3908a8000) 00000020:00000080:3.0:1790919762.053525:0:23232:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790919762.053594:0:23232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f3b4511000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919762.053598:0:23232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f3b4511000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790919762.053600:0:23232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f3b4511000 3 00010000:00080000:3.0:1790919762.053625:0:23232:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f2843f1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00000100:00100000:0.0:1790919762.054965:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978319616 00000100:00100000:0.0:1790919762.054977:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978319616 00000100:00100000:0.0:1790919762.055121:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919762.055129:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978319616:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790919762.055159:0:21904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1790919762.055196:0:21904:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x951c50ad159151d4 00000004:00100000:0.0:1790919762.055211:0:21904:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919762.055241:0:21904:0:(import.c:65:import_set_state_nolock()) ffff95f3b600d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919762.055319:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3457:x1877914978319616:12345-0@lo:38:llog_process_th.0 Request processed in 190us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919762.055327:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790919762.055440:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3b4316300 x1877914978319616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919762.055451:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919762.055459:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790919762.055468:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790919762.055471:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790919762.055474:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f286ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919762.055480:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3457:1877914978319616:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1790919762.056033:0:23232:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1790919762.056568:0:23232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790919762.056606:0:23232:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790919762.056617:0:23232:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x951c50ad159151db 00000100:00080000:3.0:1790919762.056624:0:23232:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919762.056633:0:23232:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff95f2843f1800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919762.056661:0:23232:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a0018000 x1877914978320256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919762.056682:0:23232:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790919762.056706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.056711:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.056714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.056717:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.056720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.056730:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790919762.056733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790919762.056735:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790919762.056940:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1790919762.057154:0:23208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790919762.057181:0:23208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790919762.057195:0:23208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151b8 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.057205:0:23208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2d800/0x951c50ad159151b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151b8 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790919762.057246:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790919762.057248:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919762.057250:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919762.057251:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919762.057252:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919762.057254:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919762.057255:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919762.057257:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919762.057258:0:23208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919762.057262:0:23208:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790919762.057264:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790919762.057266:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790919762.057267:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919762.057268:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919762.057269:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919762.057270:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919762.057271:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919762.057272:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919762.057278:0:23208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790919762.057293:0:23208:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790919762.057306:0:23208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978320384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790919762.057364:0:23208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919762.057396:0:23208:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398f87cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919762.057417:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320384 00000100:00100000:1.0:1790919762.057423:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320384 00000100:00100000:0.0:1790919762.057456:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978320256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919762.057457:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790919762.057465:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23208:x1877914978320384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919762.057489:0:21896:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790919762.057500:0:21896:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790919762.057500:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919762.057537:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320256 00000100:00100000:0.0:1790919762.057541:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320256 00000100:00100000:0.0:1790919762.057560:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919762.057565:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3457:x1877914978320256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790919762.057591:0:21905:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1790919762.057625:0:21905:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x951c50ad159151e2 00000004:00100000:0.0:1790919762.057636:0:21905:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919762.057661:0:21905:0:(import.c:65:import_set_state_nolock()) ffff95f3b600c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919762.057700:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3457:x1877914978320256:12345-0@lo:38:llog_process_th.0 Request processed in 134us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919762.057707:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790919762.057738:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3a0018000 x1877914978320256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919762.057747:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919762.057753:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790919762.057758:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790919762.057761:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790919762.057764:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f2843f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790919762.057769:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3457:1877914978320256:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1790919762.078530:0:21896:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790919762.078580:0:21896:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790919762.079519:0:21919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790919762.079527:0:21919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790919762.079559:0:21919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079577:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591512c expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079585:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591513a expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079593:0:21919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079632:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079647:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 21 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919762.079662:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978320512:0@lo:104: 00000100:00100000:2.0:1790919762.079728:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919762.079782:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.079801:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 21 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919762.079810:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978320640:0@lo:104: 00000100:00100000:2.0:1790919762.079836:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919762.079901:0:21919:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3851d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790919762.081252:0:21887:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790919762.081282:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320512 00000100:00100000:1.0:1790919762.081291:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320512 00000100:00100000:1.0:1790919762.081328:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320640 00000100:00100000:1.0:1790919762.081331:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320640 00000100:00100000:1.0:1790919762.081347:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919762.081356:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978320512:12345-0@lo:104: 00010000:00010000:1.0:1790919762.081371:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081726:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919762.081734:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978320512:12345-0@lo:104: Request processed in 379us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.081742:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919762.081760:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919762.081766:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f28429c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978320640:12345-0@lo:104: 00010000:00010000:1.0:1790919762.081799:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081838:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919762.081844:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f28429c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978320640:12345-0@lo:104: Request processed in 79us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.081850:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790919762.081887:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919762.081894:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081901:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1c00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919762.081906:0:21893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081914:0:21893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919762.081922:0:21893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919762.081929:0:21893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919762.081961:0:21893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081968:0:21893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919762.081989:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.081996:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3857a1c00/0x951c50ad1591513a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915141 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082015:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919762.082019:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082024:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919762.082027:0:21893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082033:0:21893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919762.082039:0:21893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919762.082045:0:21893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919762.082085:0:21893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082091:0:21893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919762.082108:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082114:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591512c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915133 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082127:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919762.082129:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919762.082131:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919762.082152:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978320768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919762.082207:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919762.082256:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978320896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919762.082283:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919762.082317:0:21891:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320768 00000100:00100000:1.0:1790919762.082322:0:21891:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320768 00010000:00010000:1.0:1790919762.082341:0:21891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 22 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919762.082360:0:21891:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978320896 00000100:00100000:1.0:1790919762.082363:0:21891:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978320896 00010000:00010000:1.0:1790919762.082374:0:21891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 23 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919762.082387:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919762.082394:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:3461:x1877914978320768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919762.082404:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919762.082409:0:21891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 23 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082419:0:21891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 23 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082434:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919762.082461:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:3461:x1877914978320768:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.082467:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919762.082481:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919762.082487:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:3458:x1877914978320896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919762.082495:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919762.082507:0:21891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 22 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082516:0:21891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 22 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082528:0:21891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082536:0:21891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790919762.082549:0:21891:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006425062s 00010000:00010000:1.0:1790919762.082554:0:21891:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082560:0:21891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082568:0:21891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082574:0:21891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082580:0:21891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919762.082584:0:21891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082592:0:21891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082601:0:21891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919762.082617:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919762.082646:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:3458:x1877914978320896:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.082652:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919762.082713:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978320896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919762.082738:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978320768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919762.082902:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919762.083252:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591513a expref: 21 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919762.083279:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978320512:0@lo:104: 00010000:00010000:2.0:1790919762.083294:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2c400/0x951c50ad15915133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad1591512c expref: 20 pid: 21896 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919762.083302:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978320640:0@lo:104: 00010000:00010000:2.0:1790919762.083318:0:21919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.083327:0:21919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.083333:0:21919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919762.083339:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a1600/0x951c50ad159151e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919762.090228:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:23208:x1877914978320384:12345-0@lo:253:mount.lustre.0 Request processed in 32754us (32855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919762.090242:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790919762.090378:0:23208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23208:1877914978320384:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919762.090393:0:23208:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790919762.090397:0:23208:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919762.090398:0:23208:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790919762.090399:0:23208:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919762.090400:0:23208:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919762.090401:0:23208:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919762.090403:0:23208:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919762.090404:0:23208:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919762.090406:0:23208:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919762.090407:0:23208:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790919762.090421:0:23208:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919762.090852:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919762.091033:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919762.091384:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919762.091543:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919762.091713:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919762.091901:0:23208:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790919762.092811:0:23208:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1790919762.138176:0:23208:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790919762.138198:0:23208:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790919762.138234:0:23208:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790919762.138292:0:23208:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790919762.138310:0:23208:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790919762.138339:0:23208:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:2.0:1790919762.909048:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919763.036605:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790919763.421123:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790919763.421132:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f286c1f000 from 13 10000000:01000000:1.0:1790919763.421138:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790919763.421185:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919763.421196:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919763.421207:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919763.421232:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919763.421309:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919763.421354:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919763.421558:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321024 00000100:00100000:2.0:1790919763.421567:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321024 00000100:00100000:2.0:1790919763.421621:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790919763.421630:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+19:21900:x1877914978321024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919763.421644:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919763.421656:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159151f0 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.421677:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159151f0 expref: 20 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.421687:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151f0 expref: 20 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.421695:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0600, rc 0) 00000100:00100000:2.0:1790919763.421749:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:21900:x1877914978321024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919763.421772:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790919763.421797:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919763.421816:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919763.421826:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919763.421878:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790919763.421910:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919763.421967:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6816d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919763.422333:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321152 00000100:00100000:1.0:1790919763.422338:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321152 00000100:00100000:1.0:1790919763.422374:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790919763.422388:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:21900:x1877914978321152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919763.422405:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919763.422419:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919763.422422:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1790919763.422514:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:21900:x1877914978321152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919763.422523:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790919763.422529:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790919763.422583:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790919763.422589:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919763.422598:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919763.422606:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790919763.422609:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4169000 from 13 10000000:01000000:0.0:1790919763.422611:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790919763.422626:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919763.422633:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919763.422641:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919763.422656:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919763.422694:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919763.422718:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321280 00000100:00100000:0.0:1790919763.422723:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6816d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790919763.422725:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321280 00000100:00100000:2.0:1790919763.422768:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919763.422775:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:21900:x1877914978321280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919763.422791:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919763.422802:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159151fe expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.422817:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159151fe expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.422825:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151fe expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.422831:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1800, rc 0) 00000100:00100000:2.0:1790919763.422865:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978321280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919763.422871:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790919763.422903:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919763.422915:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.422922:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919763.422964:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919763.423002:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919763.423018:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f386444c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919763.423022:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321408 00000100:00100000:0.0:1790919763.423027:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321408 00000100:00100000:0.0:1790919763.423070:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790919763.423077:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978321408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790919763.423086:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790919763.423110:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790919763.423113:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1790919763.423416:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978321408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 339us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919763.423423:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790919763.423573:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978321408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790919763.423623:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790919763.423629:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919763.423636:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.062316:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919764.124257:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919749/real 1790919749] req@ffff95f285ac3800 x1877914978308096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919764.124285:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f285ac3800 x1877914978308096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919764.124296:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919749/real 1790919749] req@ffff95f3ae84aa00 x1877914978308352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919764.124308:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f3ae84aa00 x1877914978308352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790919764.124327:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919764.124348:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919764.124352:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978308096:0@lo:8:kworker.0 00000100:00080000:0.0:1790919764.124357:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919764.124362:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790919764.124365:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978308352:0@lo:8:kworker.0 00000100:00080000:1.0:1790919764.124484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919764.124488:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790919764.124491:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3903e3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919764.124496:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1790919764.124501:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790919764.124510:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95f3903e3800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919764.124527:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac0a80 x1877914978321792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919764.124540:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919764.124543:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790919764.124545:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790919764.124548:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1790919764.124551:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790919764.124555:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1790919764.124564:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f285ac3100 x1877914978321920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790919764.124584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919764.124594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790919764.124597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790919764.124600:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790919764.124634:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978321664:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.124691:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919764.124721:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978322432:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.124745:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919764.124763:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919764.124768:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978322048:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.124800:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919764.124814:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978322560:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.124837:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919764.124865:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321664 00000100:00100000:1.0:1790919764.124872:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321664 00000100:00100000:1.0:1790919764.124913:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919764.124923:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978321664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.124971:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978321664:12345-0@lo:400:kworker.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919764.124978:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790919764.125000:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322432 00000100:00100000:1.0:1790919764.125004:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322432 00000100:00100000:1.0:1790919764.125025:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322048 00000100:00100000:1.0:1790919764.125027:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322048 00000100:00100000:1.0:1790919764.125036:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322560 00000100:00100000:1.0:1790919764.125038:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322560 00000100:00100000:1.0:1790919764.125081:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919764.125098:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978322432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.125130:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978322432:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919764.125136:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919764.125148:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919764.125154:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.125177:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978322048:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919764.125183:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919764.125193:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919764.125199:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978322560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.125221:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978322560:12345-0@lo:400:kworker.0 Request processed in 22us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919764.125227:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1790919764.125259:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285ac3800 x1877914978322048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919764.125271:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978322048:0@lo:400:kworker.0 00010000:00080000:1.0:1790919764.125281:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f391516300 x1877914978322560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919764.125290:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978322560:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.125298:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978321664:0@lo:400:kworker.0 00010000:00080000:1.0:1790919764.125306:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285ac2680 x1877914978322432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919764.125314:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978322432:0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125395:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978322176:0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125424:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.125449:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790919764.125455:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978321536:0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125481:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.125515:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978322304:0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125536:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.125559:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322304 00000100:00100000:0.0:1790919764.125563:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322304 00000100:00100000:0.0:1790919764.125582:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919764.125588:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978322304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125621:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978322304:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919764.125627:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1790919764.125658:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919764.125662:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790919764.125671:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321536 00000100:00100000:0.0:1790919764.125674:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321536 00000100:00100000:0.0:1790919764.125695:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790919764.125701:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978321536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919764.125729:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978321536:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919764.125735:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790919764.125788:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978321792:0@lo:8:kworker.0 00000100:00100000:0.0:1790919764.125816:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.125832:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978321920:0@lo:8:kworker.0 00000100:00100000:0.0:1790919764.125855:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.125884:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978321536:0@lo:400:kworker.0 00010000:00080000:0.0:1790919764.125894:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285ac0e00 x1877914978322304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919764.125903:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978322304:0@lo:400:kworker.0 00000100:00100000:1.0:1790919764.125973:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321792 00000100:00100000:1.0:1790919764.125977:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321792 00000100:00100000:1.0:1790919764.126029:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978321920 00000100:00100000:1.0:1790919764.126032:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978321920 00000100:00100000:0.0:1790919764.129589:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919764.129601:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978321792:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790919764.129632:0:23212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1790919764.129663:0:23212:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591520c 00002000:00100000:0.0:1790919764.129679:0:23212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff95f391a0c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790919764.129683:0:23212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790919764.129685:0:23212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790919764.130011:0:23212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919764.130034:0:23212:0:(import.c:65:import_set_state_nolock()) ffff95f391a0e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919764.130136:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978321792:12345-0@lo:8:kworker.0 Request processed in 535us (4319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919764.130144:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790919764.130164:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919764.130168:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978321920:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790919764.130181:0:23212:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790919764.130206:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978321920:12345-0@lo:8:kworker.0 Request processed in 36us (4350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790919764.130212:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790919764.130251:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f285ac0a80 x1877914978321792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919764.130262:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919764.130270:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790919764.130277:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790919764.130282:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790919764.130284:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790919764.130304:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790919764.130310:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978321792:0@lo:8:kworker.0 00000100:00080000:0.0:1790919764.130324:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790919764.130329:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790919764.130332:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978321920:0@lo:8:kworker.0 00000004:00080000:0.0:1790919764.130388:0:21928:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1790919764.130405:0:21928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21928:1877914978322816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790919764.130438:0:21928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.130457:0:21928:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6816240 going to sleep for 11 seconds 00000100:00100000:0.0:1790919764.130468:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919764.130477:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978322688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919764.130500:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919764.130529:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322816 00000100:00100000:0.0:1790919764.130535:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322816 00000100:00100000:0.0:1790919764.130566:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790919764.130572:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21928:x1877914978322816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790919764.132715:0:23212:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1790919764.132725:0:23212:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1790919764.132730:0:23212:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:3.0:1790919764.132886:0:21927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790919764.133199:0:21927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 573161145158ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790919764.133359:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322688 00000100:00100000:1.0:1790919764.133370:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322688 00000100:00100000:1.0:1790919764.133410:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919764.133419:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978322688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919764.133453:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919764.133537:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3459:x1877914978322688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919764.133544:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790919764.134116:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322176 00000100:00100000:3.0:1790919764.134123:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322176 00000100:00100000:3.0:1790919764.134158:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790919764.134165:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978322176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919764.134216:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978322176:12345-0@lo:400:kworker.0 Request processed in 52us (8791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919764.134223:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1790919764.137102:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790919764.137166:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae848700 x1877914978322688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919764.137192:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978322688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919764.152358:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978322176:0@lo:400:kworker.0 00002000:00010000:0.0:1790919764.154347:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.154359:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154375:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.154379:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.154391:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154408:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154418:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154425:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154447:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.154936:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.154943:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154951:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.154955:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.154958:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154967:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154974:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.154992:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155007:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919764.155021:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919764.155027:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155034:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.155038:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155048:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155089:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155096:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000898791f2/0x951c50ad15915213 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155113:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.155116:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155207:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a9e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.155211:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155218:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155228:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155235:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074271611/0x951c50ad1591521a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155248:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.155250:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.155252:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.155657:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.155664:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155672:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.155676:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.155680:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155688:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155703:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155710:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155728:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.155738:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.155946:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155955:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a9400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.155959:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155967:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155978:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.155985:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016687eb6/0x951c50ad15915221 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156002:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.156010:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.156012:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.156458:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.156465:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156475:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.156479:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.156484:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156494:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156502:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156510:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156526:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.156534:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.156538:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156544:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a9800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.156548:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156568:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156579:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156587:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5fc7e5c/0x951c50ad15915228 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.156601:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.156603:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.156605:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.159163:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.159174:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159190:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.159195:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.159201:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159214:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159224:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159239:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159261:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.159672:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.159678:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159687:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.159689:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.159693:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159702:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159711:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159717:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159733:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919764.159747:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919764.159753:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159766:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.159770:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159796:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159812:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159819:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a36ad781/0x951c50ad1591522f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159836:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.159840:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159847:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.159850:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159856:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159866:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159879:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbea0554/0x951c50ad15915236 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.159892:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.159894:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.159896:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.160308:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.160315:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160324:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.160327:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.160332:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160342:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160350:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160357:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160382:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.160795:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.160808:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160815:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.160818:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1790919764.160821:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160821:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.160825:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160830:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a9600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.160834:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160835:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160843:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160844:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160852:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.160860:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919764.160871:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160879:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3b0b007/0x951c50ad1591523d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160897:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919764.160900:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160907:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a9c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.160911:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160918:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160928:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160934:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080a9791c/0x951c50ad15915244 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.160945:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.160947:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.160954:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919764.161151:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.161380:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.161387:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.161392:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.161395:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.161399:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.161403:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161413:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161428:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161435:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161495:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.161923:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.161929:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161938:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.161941:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.161945:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161955:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161963:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.161971:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164471:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919764.164483:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164498:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369fc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.164504:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164516:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164534:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164542:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d35ec7e/0x951c50ad1591524b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164569:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919764.164573:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164579:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369f600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.164583:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164602:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164612:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.164619:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.164621:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.164622:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.165122:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790919764.165131:0:23212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009771c70c/0x951c50ad15915252 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919764.165246:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.165819:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.165827:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.165839:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.165844:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.165849:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.165861:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.165871:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.165879:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.166330:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.166767:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.166784:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.166800:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.166804:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.166808:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.166819:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.166827:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.166833:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167311:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919764.167324:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919764.167331:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167341:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369f800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.167345:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167355:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167385:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167392:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0b2edf/0x951c50ad15915259 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167417:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.167420:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167427:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369f000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.167430:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167438:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167447:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167454:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f754fba5/0x951c50ad15915260 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167466:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.167468:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.167476:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.167942:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.167948:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167958:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.167962:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.167966:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167975:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167984:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.167992:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168008:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.168017:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.168022:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168029:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369fe00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.168033:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168082:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168094:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168101:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000517d7e56/0x951c50ad15915267 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168118:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.168120:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.168121:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.168553:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.168559:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168566:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.168569:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.168573:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168580:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168587:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168600:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.168610:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.169016:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.169022:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169030:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.169033:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.169037:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169045:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169078:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169086:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169102:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919764.169112:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919764.169116:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169128:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369f200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.169132:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169140:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169152:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169160:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb2bf667/0x951c50ad1591526e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169178:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.169181:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169188:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369ea00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.169191:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169198:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169208:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169221:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6808a48/0x951c50ad15915275 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169235:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.169237:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.169238:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.169646:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.169651:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169659:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.169662:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.169666:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169675:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169683:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169690:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169703:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.169712:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.169721:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169728:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369fa00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.169731:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169742:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169752:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169758:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2921e5/0x951c50ad1591527c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.169773:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.169786:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.169788:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.170197:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.170203:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170212:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.170215:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.170219:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170237:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170245:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170252:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170268:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.170276:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.170280:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170287:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369e200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.170290:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170298:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170309:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170316:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961a4f35/0x951c50ad15915283 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170340:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.170342:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.170344:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.170746:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.170753:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.170762:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.170764:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.170768:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919764.170977:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919764.170982:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.174930:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.174954:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.174962:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.174993:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.175015:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.175020:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175047:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369e800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.175069:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175079:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175097:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175103:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d34bc6fe/0x951c50ad1591528a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175133:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.175135:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.175137:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.175690:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.175698:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175710:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.175714:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.175719:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175728:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175744:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175752:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175767:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.175788:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.175792:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175799:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369f400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.175803:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175811:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175823:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175831:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000659511d0/0x951c50ad15915291 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.175851:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.175859:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.175862:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.176321:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.176327:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176337:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.176340:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.176344:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176354:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176362:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176369:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176386:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.176394:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.176398:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176405:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369e600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.176409:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176427:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176439:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176446:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119c49bc/0x951c50ad15915298 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176462:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.176463:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.176465:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.176865:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.176871:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176879:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.176882:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.176886:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176893:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176900:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176913:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176928:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.176938:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.176941:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176948:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369ec00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.176951:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176957:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176968:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176975:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026df2d4a/0x951c50ad1591529f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.176989:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.176990:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.176992:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.177412:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.177425:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177434:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.177437:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.177441:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177451:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177460:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177467:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177481:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.177491:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.177495:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177501:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369ee00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.177505:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177512:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177531:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177538:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5fb5fda/0x951c50ad159152a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.177554:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.177556:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.177558:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.183400:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.183414:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183431:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.183435:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.183441:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183455:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183465:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183474:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183508:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.183946:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.183952:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183961:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.183964:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.183968:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183977:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183985:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.183993:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184009:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790919764.184020:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919764.184026:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184033:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369e400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.184043:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184073:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184090:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184098:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000038fcb29/0x951c50ad159152ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184125:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.184129:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184136:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38369e000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.184139:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184146:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184156:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184164:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004718a58c/0x951c50ad159152b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184180:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.184182:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.184184:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.184548:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.184554:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184563:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.184566:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.184571:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184579:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184587:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184595:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184607:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.184614:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.184618:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184635:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.184638:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184646:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184657:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184664:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a26dda/0x951c50ad159152bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.184675:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.184677:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.184679:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.185099:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.185106:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185114:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.185117:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.185122:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185131:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185146:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185153:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185167:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.185176:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.185179:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185186:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.185189:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185197:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185207:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185214:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709c0543/0x951c50ad159152c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185226:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.185233:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.185235:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.185636:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.185642:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185650:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.185652:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.185656:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185664:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185673:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185679:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185693:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.185700:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.185704:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185711:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c1400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.185714:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185737:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185748:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185755:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159152c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.185769:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.185770:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.185772:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.186243:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.186250:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.186265:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.186269:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.186273:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.186284:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.186293:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.186306:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.186321:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919764.186375:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.186376:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.186384:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.186394:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.186398:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.186407:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.186421:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.186429:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000138e2837/0x951c50ad159152d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.186465:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.186469:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.186472:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.187036:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.187043:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187078:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.187081:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.187086:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187096:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187105:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187113:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187130:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919764.187140:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919764.187151:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187159:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919764.187163:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187171:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187182:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187189:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c5b335c/0x951c50ad159152d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187202:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.187204:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919764.187206:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790919764.187614:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.187621:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187630:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.187633:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.187636:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187659:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187667:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187674:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.187742:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790919764.188239:0:23212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790919764.188246:0:23212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.188261:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1790919764.188265:0:23212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919764.188269:0:23212:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.188279:0:23212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.188287:0:23212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188295:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919764.188302:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.188305:0:23212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188311:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.188314:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919764.188321:0:23212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919764.188323:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188336:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188343:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad159152de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188361:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919764.188364:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188371:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919764.188379:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188387:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188398:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188406:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c18f5e2/0x951c50ad159152e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919764.188422:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.188425:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.188427:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919764.188434:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790919764.188599:0:23212:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1790919764.188703:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21928:x1877914978322816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 58125us (58259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919764.188713:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919764.188837:0:21928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21928:1877914978322816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790919764.188855:0:21928:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1790919764.188908:0:21928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21928:1877914978322944:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790919764.188957:0:21928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919764.188993:0:21928:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919764.189032:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978322944 00000100:00100000:0.0:1790919764.189041:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978322944 00000100:00100000:0.0:1790919764.189122:0:23210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919764.189134:0:23210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21928:x1877914978322944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790919764.189170:0:23210:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:0.0:1790919764.195924:0:23210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:21928:x1877914978322944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6785us (6961us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790919764.195937:0:23210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919764.195998:0:21928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21928:1877914978322944:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790919764.196014:0:21928:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000004:00080000:1.0:1790919764.204156:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1790919765.084260:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919765.916251:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790919765.916275:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978323072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919765.916356:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919765.916418:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323072 00000100:00100000:3.0:1790919765.916426:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323072 00000100:00100000:3.0:1790919765.917614:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919765.917636:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978323072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919765.917677:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919765.917740:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978323072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919765.918415:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978323200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919765.918458:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919765.918862:0:21908:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790919765.918871:0:21908:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1790919765.918965:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919765.918988:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323200 00000100:00100000:3.0:1790919765.918995:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323200 00000100:00100000:3.0:1790919765.919023:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919765.919032:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978323200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919765.919087:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919765.919137:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978323200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919765.919143:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790919765.919172:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391516680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978323200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919765.920157:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978323072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790919766.109192:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919767.132651:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790919767.195919:0:23579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:2.0:1790919767.508508:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1790919767.508642:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790919768.157486:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919769.180643:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790919769.501336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919769.501342:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790919769.501346:0:37:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1790919769.501348:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978323456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790919769.501353:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:2.0:1790919769.501360:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790919769.501370:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919769.501393:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3b4315500 x1877914978323840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790919769.501421:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790919769.501428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919769.501438:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790919769.501441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919769.501443:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790919769.501481:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978323968:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.501487:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978323328:0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.501512:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919769.501542:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978324480:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.501548:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919769.501570:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919769.501585:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978324096:0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.501594:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790919769.501602:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978323712:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.501633:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919769.501646:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919769.501665:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978324352:0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.501686:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919769.501717:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323456 00000100:00100000:1.0:1790919769.501724:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323456 00000100:00100000:1.0:1790919769.501783:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790919769.501792:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978323456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919769.501826:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790919769.501846:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790919769.501855:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978323584:0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.501875:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978323456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919769.501882:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919769.501889:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919769.501905:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919769.501913:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978324224:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.501949:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919769.501975:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978323840:0@lo:8:kworker.0 00000100:00100000:2.0:1790919769.502003:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919769.502044:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323328 00000100:00100000:2.0:1790919769.502048:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323328 00000100:00100000:2.0:1790919769.502229:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919769.502236:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.502277:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978323328:12345-0@lo:400:kworker.0 Request processed in 41us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919769.502282:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790919769.502307:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324096 00000100:00100000:2.0:1790919769.502311:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324096 00000100:00100000:2.0:1790919769.502333:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323584 00000100:00100000:2.0:1790919769.502336:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323584 00000100:00100000:1.0:1790919769.502359:0:3461:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790919769.502363:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919769.502371:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.502384:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978323456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919769.502412:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978324096:12345-0@lo:400:kworker.0 Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919769.502419:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919769.502434:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919769.502441:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.502474:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978323584:12345-0@lo:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919769.502481:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790919769.502521:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978323584:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.502531:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978323328:0@lo:400:kworker.0 00000100:00100000:2.0:1790919769.502553:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978324096:0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.503472:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323712 00000100:00100000:1.0:1790919769.503481:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323712 00000100:00100000:1.0:1790919769.503510:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323840 00000100:00100000:1.0:1790919769.503519:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323840 00000100:00100000:1.0:1790919769.503536:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919769.503543:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.503609:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978323712:12345-0@lo:400:kworker.0 Request processed in 67us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919769.503616:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790919769.503629:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919769.503632:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978323840:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790919769.503785:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978323712:0@lo:400:kworker.0 00010000:00020000:1.0:1790919769.503785:0:23212:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790919769.503833:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978323840:12345-0@lo:8:kworker.0 Request processed in 197us (1828us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790919769.503840:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790919769.503844:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919769.503851:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790919769.503855:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978323840:0@lo:8:kworker.0 00000100:00100000:1.0:1790919769.503864:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978323968 00000100:00100000:1.0:1790919769.503870:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978323968 00000100:00100000:1.0:1790919769.503889:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324480 00000100:00100000:1.0:1790919769.503892:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324480 00000100:00100000:1.0:1790919769.503916:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324352 00000100:00100000:1.0:1790919769.503919:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324352 00000100:00100000:1.0:1790919769.503929:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324224 00000100:00100000:1.0:1790919769.503932:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324224 00000100:00100000:1.0:1790919769.503943:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919769.503949:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.503985:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978323968:12345-0@lo:400:kworker.0 Request processed in 35us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919769.503991:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919769.504002:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919769.504008:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978324480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.504035:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978324480:12345-0@lo:400:kworker.0 Request processed in 28us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919769.504049:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919769.504083:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919769.504089:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919769.504119:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978324352:12345-0@lo:400:kworker.0 Request processed in 31us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919769.504125:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790919769.504347:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919769.504351:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790919769.504379:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3b4314380 x1877914978324352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919769.504391:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978324352:0@lo:400:kworker.0 00010000:00080000:2.0:1790919769.504405:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3b4316a00 x1877914978323968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919769.504420:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919769.504422:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978323968:0@lo:400:kworker.0 00000100:00100000:0.0:1790919769.504441:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978324224:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790919769.504442:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3b4317100 x1877914978324480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919769.504456:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978324480:0@lo:400:kworker.0 00000100:00100000:0.0:1790919769.504492:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978324224:12345-0@lo:400:kworker.0 Request processed in 55us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919769.504499:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790919769.504627:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3b4317480 x1877914978324224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919769.504649:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978324224:0@lo:400:kworker.0 00010000:00010000:1.0:1790919770.204172:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919770.653397:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790919771.036325:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978324608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919771.036403:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919771.036464:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324608 00000100:00100000:1.0:1790919771.036472:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324608 00000100:00100000:1.0:1790919771.036517:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919771.036526:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978324608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919771.036565:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919771.036609:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978324608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919771.036617:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919771.036662:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978324608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919771.039538:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978324736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919771.039608:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919771.039928:0:23504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324736 00000100:00100000:0.0:1790919771.039937:0:23504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324736 00000100:00100000:0.0:1790919771.039988:0:23504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919771.039997:0:23504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978324736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790919771.040033:0:23504:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919771.040102:0:23504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978324736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919771.040109:0:23504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790919771.040822:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978324736:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790919771.230818:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919772.126964:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790919772.253978:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790919772.686043:0:23931:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790919772.686048:0:23931:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790919772.687809:0:23931:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95f38716e000 00000020:01000004:3.0:1790919772.687828:0:23931:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790919772.687845:0:23931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790919772.687867:0:23931:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff95f3bdfe4d40) 00000020:00000080:3.0:1790919772.687886:0:23931:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790919772.705594:0:23931:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790919772.705815:0:23931:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790919772.706676:0:23931:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790919772.706889:0:23931:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790919772.707224:0:23931:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1790919772.707536:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 553: rc = 0 00100000:10000000:2.0:1790919772.707610:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 553: rc = 0 00100000:10000000:2.0:1790919772.707739:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 553: rc = 0 00100000:10000000:2.0:1790919772.708289:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1790919772.708583:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 771: rc = 0 00100000:10000000:2.0:1790919772.708815:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1790919772.709073:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1790919772.709383:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 771: rc = 0 00100000:10000000:2.0:1790919772.709621:0:23931:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 771: rc = 0 00000020:00000080:2.0:1790919772.710348:0:23931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790919772.710362:0:23931:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790919772.710378:0:23931:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad159152f3 00000020:01000004:2.0:1790919772.710385:0:23931:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790919772.710408:0:23931:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790919772.710411:0:23931:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790919772.710417:0:23931:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790919772.710438:0:23931:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790919772.710441:0:23931:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790919772.718409:0:23931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790919772.718448:0:23931:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790919772.718453:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790919772.718454:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919772.718455:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919772.718456:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919772.718457:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919772.718459:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919772.718460:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919772.718462:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919772.718463:0:23931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919772.718467:0:23931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790919772.718469:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790919772.718470:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919772.718471:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919772.718472:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919772.718473:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919772.718474:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919772.718476:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919772.718477:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919772.718477:0:23931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790919772.718502:0:23931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790919772.718522:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978324864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790919772.718600:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.718705:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919772.718760:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324864 00000100:00100000:0.0:1790919772.718768:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324864 00000100:00100000:0.0:1790919772.718847:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790919772.718856:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23931:x1877914978324864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790919772.718884:0:21897:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790919772.718887:0:21897:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790919772.718891:0:21897:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790919772.724675:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23931:x1877914978324864:12345-0@lo:253:mount.lustre.0 Request processed in 5812us (6066us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.724689:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790919772.725011:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978324864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790919772.725025:0:23931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790919772.725040:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790919772.725042:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790919772.725044:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790919772.725045:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790919772.725046:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790919772.725047:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790919772.725049:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790919772.725079:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790919772.725081:0:23931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790919772.725108:0:23931:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95f38716e000 from lustre-OST0001 10000000:01000000:2.0:1790919772.725141:0:23931:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790919772.725144:0:23931:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790919772.725151:0:23931:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff95f38d580000 local copy 00010000:00010000:2.0:1790919772.725161:0:23931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919772.725340:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978324992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919772.725376:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.725401:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919772.725510:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978324992 00000100:00100000:0.0:1790919772.725516:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978324992 00000100:00100000:0.0:1790919772.725552:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790919772.725559:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23931:x1877914978324992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790919772.725706:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23931:x1877914978324992:12345-0@lo:501:mount.lustre.0 Request processed in 147us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790919772.725723:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790919772.725799:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978324992:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790919772.725811:0:23931:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790919772.725939:0:23931:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790919772.725946:0:23931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.725955:0:23931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c000/0x951c50ad15914f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15914f3b expref: -99 pid: 21886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919772.725974:0:23931:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95f38716e000 10000000:01000000:1.0:1790919772.725979:0:23931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790919772.725982:0:23931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790919772.725985:0:23931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919772.725989:0:23931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790919772.725991:0:23931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790919772.726012:0:23931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.726019:0:23931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.726028:0:23931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.726040:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919772.726097:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.726123:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852bed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790919772.726215:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325120 00000100:00100000:0.0:1790919772.726220:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325120 00000100:00100000:0.0:1790919772.726246:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790919772.726252:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:23931:x1877914978325120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790919772.726260:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919772.726271:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1c00/0x951c50ad15915301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159152fa expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919772.726289:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1c00/0x951c50ad15915301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159152fa expref: 22 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919772.726299:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1c00/0x951c50ad15915301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159152fa expref: 22 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919772.726307:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1c00, rc 0) 00000100:00100000:0.0:1790919772.726333:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325120:12345-0@lo:101:mount.lustre.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.726338:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790919772.726439:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919772.726451:0:23931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915301 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.726470:0:23931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915301 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919772.726993:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1790919772.727884:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919772.728271:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790919772.728309:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790919772.728335:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790919772.728373:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790919772.728404:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790919772.728432:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790919772.728473:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790919772.728507:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790919772.728549:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1790919772.728598:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1790919772.728606:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1790919772.728678:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919772.728745:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.728790:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be300 going to sleep for 11 seconds 00000100:00100000:2.0:1790919772.728866:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325248 00000100:00100000:2.0:1790919772.728874:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325248 00000100:00100000:2.0:1790919772.728922:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790919772.728931:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919772.729270:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325248:12345-0@lo:501:mount.lustre.0 Request processed in 339us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919772.729278:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790919772.729393:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919772.729424:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919772.729461:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.729480:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852be300 going to sleep for 11 seconds 00000100:00100000:2.0:1790919772.729588:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325376 00000100:00100000:2.0:1790919772.729592:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325376 00000100:00100000:2.0:1790919772.729685:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790919772.729693:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919772.729977:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325376:12345-0@lo:503:mount.lustre.0 Request processed in 284us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919772.729991:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790919772.730235:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391517b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790919772.730797:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790919772.730873:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919772.730922:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.730948:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390edb300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.731103:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325504 00000100:00100000:1.0:1790919772.731209:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325504 00000100:00100000:1.0:1790919772.731243:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790919772.731251:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.731514:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325504:12345-0@lo:502:mount.lustre.0 Request processed in 263us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.731522:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790919772.731654:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919772.731892:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1790919772.731940:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1790919772.731987:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1790919772.732038:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1790919772.732279:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1790919772.732312:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1790919772.732359:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1790919772.732396:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1790919772.732444:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1790919772.732478:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790919772.732532:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.732610:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390edb300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.732680:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325632 00000100:00100000:1.0:1790919772.732686:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325632 00000100:00100000:1.0:1790919772.732772:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790919772.732780:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.732956:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325632:12345-0@lo:502:mount.lustre.0 Request processed in 177us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.732963:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790919772.733307:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790919772.733380:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1790919772.733391:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1790919772.734176:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790919772.734184:0:23932:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790919772.734190:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.734193:0:23932:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790919772.734198:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790919772.734210:0:23932:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95f3a687cd40) 00000020:00000080:0.0:1790919772.734232:0:23932:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790919772.734236:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790919772.734310:0:23932:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f38716e000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790919772.734317:0:23932:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790919772.734324:0:23932:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x951c50ad1591530f 00010000:00010000:0.0:1790919772.738287:0:23932:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1790919772.738724:0:23932:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1790919772.740674:0:23932:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1790919772.741819:0:23932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790919772.741837:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919772.741844:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.741846:0:23932:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790919772.741849:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919772.741853:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.741854:0:23932:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790919772.741858:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790919772.741860:0:23932:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790919772.741862:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919772.741864:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.741866:0:23932:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790919772.741868:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790919772.741871:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.741872:0:23932:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790919772.741875:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790919772.741927:0:23932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790919772.741930:0:23932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790919772.741932:0:23932:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790919772.741935:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1790919772.744341:0:23931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790919772.744383:0:23931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790919772.744404:0:23931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915301 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919772.744417:0:23931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1ce00/0x951c50ad159152fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915301 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919772.744425:0:23931:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f38716e000 from 1 10000000:01000000:3.0:1790919772.744428:0:23931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919772.744465:0:23931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919772.744486:0:23931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919772.744498:0:23931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919772.744524:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790919772.744593:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919772.744638:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b900 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.746327:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325760 00000100:00100000:1.0:1790919772.746338:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325760 00000100:00100000:1.0:1790919772.746389:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790919772.746398:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978325760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919772.746413:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919772.746429:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915316 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.746453:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.746464:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.746472:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d200, rc 0) 00000100:00100000:1.0:1790919772.746534:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978325760:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.746551:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790919772.746679:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790919772.746696:0:23931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919772.746704:0:23931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790919772.748376:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790919772.750556:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790919772.750859:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790919772.750904:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790919772.750956:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790919772.750993:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790919772.751027:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790919772.752881:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790919772.752957:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790919772.752995:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790919772.753046:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790919772.753594:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790919772.753662:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790919772.753769:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790919772.753777:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790919772.753876:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919772.753938:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.754020:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790919772.754302:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978325888 00000100:00100000:3.0:1790919772.754310:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978325888 00000100:00100000:3.0:1790919772.754356:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790919772.754366:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978325888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790919772.754573:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978325888:12345-0@lo:501:mount.lustre.0 Request processed in 208us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919772.754581:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790919772.754663:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978325888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790919772.754693:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790919772.754738:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.754765:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.754806:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326016 00000100:00100000:1.0:1790919772.754811:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326016 00000100:00100000:1.0:1790919772.754840:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790919772.754847:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919772.754977:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326016:12345-0@lo:503:mount.lustre.0 Request processed in 130us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.754984:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790919772.755073:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790919772.755574:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790919772.755641:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919772.755680:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.755710:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.755849:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326144 00000100:00100000:1.0:1790919772.755854:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326144 00000100:00100000:1.0:1790919772.755885:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790919772.755892:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.756031:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326144:12345-0@lo:502:mount.lustre.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.756038:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790919772.756231:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919772.756431:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790919772.756469:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790919772.756506:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790919772.756533:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790919772.756558:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790919772.756592:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790919772.756624:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790919772.756657:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790919772.756700:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790919772.756743:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790919772.756770:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790919772.756795:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919772.756837:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.756934:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b67daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.757298:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326272 00000100:00100000:1.0:1790919772.757303:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326272 00000100:00100000:1.0:1790919772.757365:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790919772.757372:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.757526:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326272:12345-0@lo:502:mount.lustre.0 Request processed in 154us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.757534:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790919772.757592:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790919772.757690:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790919772.757699:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790919772.758443:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919772.758451:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758454:0:23936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790919772.758460:0:23936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f38716e000 00000020:00000080:2.0:1790919772.758462:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919772.758468:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919772.758470:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758471:0:23936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790919772.758473:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919772.758476:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758477:0:23936:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790919772.758486:0:23936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95f38716e000 00000020:00000080:2.0:1790919772.758488:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919772.758541:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919772.758544:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758545:0:23936:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790919772.758547:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919772.758550:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758551:0:23936:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919772.758554:0:23936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f38716e000 00000020:00000080:2.0:1790919772.758556:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919772.758571:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919772.758573:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758574:0:23936:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790919772.758576:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790919772.758578:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758580:0:23936:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790919772.758583:0:23936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95f38716e000 00000020:00000080:2.0:1790919772.758585:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790919772.758614:0:23936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790919772.758617:0:23936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790919772.758618:0:23936:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790919772.758621:0:23936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790919772.762132:0:23931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790919772.762175:0:23931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919772.762197:0:23931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.762220:0:23931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919772.762270:0:23931:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790919772.762273:0:23931:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95f38716e000 10000000:01000000:1.0:1790919772.762276:0:23931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95f38716e000 10000000:01000000:1.0:1790919772.762280:0:23931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790919772.762286:0:23931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95f38716e000 from 1 10000000:01000000:1.0:1790919772.762288:0:23931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790919772.762322:0:23931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.762330:0:23931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.762341:0:23931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.762363:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790919772.762422:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919772.762450:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326400 00000100:00100000:2.0:1790919772.762457:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326400 00000100:00100000:1.0:1790919772.762461:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919772.762495:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790919772.762504:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:23931:x1877914978326400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790919772.762517:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919772.762529:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1c00/0x951c50ad1591532b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915324 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919772.762552:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1c00/0x951c50ad1591532b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915324 expref: 24 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919772.762572:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1c00/0x951c50ad1591532b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915324 expref: 24 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919772.762579:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1c00, rc 0) 00000100:00100000:2.0:1790919772.762625:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326400:12345-0@lo:101:mount.lustre.0 Request processed in 122us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919772.762631:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790919772.762738:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790919772.762751:0:23931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591532b expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.762759:0:23931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591532b expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790919772.763583:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1790919772.764454:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790919772.765093:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1790919772.765145:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1790919772.765180:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1790919772.765226:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1790919772.765262:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1790919772.765308:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1790919772.765344:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1790919772.765376:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1790919772.765419:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1790919772.765453:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1790919772.765488:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1790919772.765534:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1790919772.765569:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1790919772.765680:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1790919772.765748:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1790919772.766637:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1790919772.766684:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1790919772.766752:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1790919772.766789:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1790919772.766948:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1790919772.767091:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1790919772.767127:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1790919772.767157:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1790919772.767203:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1790919772.767238:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1790919772.767271:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1790919772.767318:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1790919772.767353:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1790919772.767388:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1790919772.767454:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1790919772.767492:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1790919772.767524:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1790919772.767556:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1790919772.767602:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1790919772.767639:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1790919772.767682:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1790919772.768157:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1790919772.768220:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1790919772.768290:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1790919772.768330:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1790919772.768357:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1790919772.768382:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1790919772.768421:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1790919772.768456:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1790919772.768489:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1790919772.768551:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1790919772.768655:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1790919772.768696:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1790919772.769046:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1790919772.769100:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1790919772.769319:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1790919772.769329:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1790919772.769434:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919772.769494:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.769535:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326528 00000100:00100000:1.0:1790919772.769542:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326528 00000100:00100000:1.0:1790919772.769591:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919772.769674:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919772.771066:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326528:12345-0@lo:501:mount.lustre.0 Request processed in 1378us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.771085:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790919772.771141:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852beb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.771164:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790919772.771207:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790919772.771247:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.771272:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f2852beb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919772.771811:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326656 00000100:00100000:3.0:1790919772.771819:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326656 00000100:00100000:3.0:1790919772.771855:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790919772.771864:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790919772.772524:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326656:12345-0@lo:503:mount.lustre.0 Request processed in 659us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919772.772534:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790919772.772919:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790919772.773575:0:23931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790919772.773648:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.773700:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.773751:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326784 00000100:00100000:1.0:1790919772.773757:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326784 00000100:00100000:1.0:1790919772.773801:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919772.773810:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.773995:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326784:12345-0@lo:502:mount.lustre.0 Request processed in 185us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.774002:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790919772.774047:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.774086:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919772.776358:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790919772.776428:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1790919772.776460:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1790919772.778262:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1790919772.778344:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1790919772.778401:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1790919772.778461:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1790919772.778494:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1790919772.778541:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790919772.778573:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1790919772.778603:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1790919772.778649:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1790919772.778681:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1790919772.778722:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1790919772.778770:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1790919772.778803:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1790919772.778835:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1790919772.778883:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1790919772.778918:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1790919772.778950:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1790919772.778994:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1790919772.779027:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1790919772.779098:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1790919772.779740:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1790919772.779778:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1790919772.779805:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1790919772.779845:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1790919772.779876:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1790919772.779907:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1790919772.779951:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1790919772.779986:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1790919772.780018:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1790919772.780073:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1790919772.780422:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1790919772.780466:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1790919772.780529:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1790919772.780567:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1790919772.780595:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1790919772.780662:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1790919772.780710:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1790919772.780758:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1790919772.780788:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1790919772.780834:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1790919772.780871:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1790919772.780904:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1790919772.780950:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1790919772.780984:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1790919772.781017:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1790919772.781130:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.781203:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.781238:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919772.783126:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978326912 00000100:00100000:2.0:1790919772.783199:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978326912 00000100:00100000:2.0:1790919772.783252:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790919772.783260:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919772.783491:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978326912:12345-0@lo:502:mount.lustre.0 Request processed in 231us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919772.783499:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790919772.783866:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978326912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919772.784008:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1790919772.784075:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1790919772.784108:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978327040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790919772.784292:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.784334:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3bc12b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790919772.785732:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327040 00000100:00100000:2.0:1790919772.785743:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327040 00000100:00100000:2.0:1790919772.785816:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790919772.785826:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978327040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790919772.786068:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978327040:12345-0@lo:502:mount.lustre.0 Request processed in 225us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919772.786077:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790919772.786236:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f391515f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978327040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790919772.786371:0:23931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1790919772.786384:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790919772.790329:0:23942:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790919772.790347:0:23942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff95f3a687b380) 00000020:00000080:0.0:1790919772.790372:0:23942:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790919772.790440:0:23942:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f38716e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790919772.790444:0:23942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f38716e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790919772.790447:0:23942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f38716e000 3 00010000:00080000:0.0:1790919772.790476:0:23942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f3ac514000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919772.792856:0:23942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1790919772.793752:0:23942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790919772.793795:0:23942:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790919772.793807:0:23942:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x951c50ad15915339 00000100:00080000:0.0:1790919772.793818:0:23942:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790919772.793829:0:23942:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95f3ac514000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919772.793863:0:23942:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3ae84ad80 x1877914978327168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919772.793895:0:23942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790919772.793948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919772.793951:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790919772.793953:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790919772.793958:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1790919772.793960:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790919772.793965:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1790919772.793978:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f284c0ea00 x1877914978327552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790919772.794019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919772.794023:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919772.794026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919772.794029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790919772.794081:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978327808:0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.794143:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.794178:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790919772.794184:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978327680:0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.794210:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.794228:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978328192:0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.794248:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.794274:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327680 00000100:00100000:0.0:1790919772.794280:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327680 00000100:00100000:0.0:1790919772.794316:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328192 00000100:00100000:0.0:1790919772.794325:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328192 00000100:00100000:0.0:1790919772.794355:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919772.794363:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978327680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.794415:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978327680:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.794422:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919772.794437:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790919772.794442:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978328192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.794469:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978328192:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.794475:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790919772.794922:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978327168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919772.794958:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.794987:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978327552:0@lo:8:kworker.0 00000100:00100000:1.0:1790919772.795012:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.795041:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978327296:0@lo:400:kworker.0 00000100:00100000:1.0:1790919772.795274:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.795343:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978327936:0@lo:400:kworker.0 00000100:00100000:1.0:1790919772.795366:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.795385:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790919772.795390:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978327424:0@lo:400:kworker.0 00000100:00100000:1.0:1790919772.795412:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.795428:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978328064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919772.795449:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790919772.795632:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f284c0df80 x1877914978327680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919772.795646:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978327680:0@lo:400:kworker.0 00010000:00080000:0.0:1790919772.795661:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f284c0e300 x1877914978328192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919772.795669:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978328192:0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.796237:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327552 00000100:00100000:0.0:1790919772.796246:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327552 00000100:00100000:0.0:1790919772.796275:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327424 00000100:00100000:0.0:1790919772.796277:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327424 00000100:00100000:0.0:1790919772.796306:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919772.796313:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978327424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.796383:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978327424:12345-0@lo:400:kworker.0 Request processed in 69us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.796391:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790919772.796415:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919772.796419:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978327552:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790919772.796469:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3457:x1877914978327552:12345-0@lo:8:kworker.0 Request processed in 48us (1455us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790919772.796475:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919772.796494:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327168 00000100:00100000:0.0:1790919772.796566:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327168 00000100:00100000:0.0:1790919772.796582:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327936 00000100:00100000:0.0:1790919772.796585:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327936 00000100:00100000:0.0:1790919772.796595:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328064 00000100:00100000:0.0:1790919772.796598:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328064 00000100:00100000:0.0:1790919772.796612:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919772.796618:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978327936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.796652:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978327936:12345-0@lo:400:kworker.0 Request processed in 33us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.796658:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790919772.796670:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919772.796676:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978328064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919772.796704:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978328064:12345-0@lo:400:kworker.0 Request processed in 28us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.796709:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790919772.796731:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919772.796735:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978327168:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790919772.796751:0:21904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:0.0:1790919772.796784:0:21904:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x951c50ad15915340 00000004:00100000:0.0:1790919772.796798:0:21904:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790919772.796828:0:21904:0:(import.c:65:import_set_state_nolock()) ffff95f38716b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919772.796870:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3457:x1877914978327168:12345-0@lo:38:llog_process_th.0 Request processed in 133us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.796876:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790919772.797791:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790919772.797797:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790919772.797800:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919772.798881:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327808 00000100:00100000:3.0:1790919772.798891:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327808 00000100:00100000:3.0:1790919772.798931:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978327296 00000100:00100000:3.0:1790919772.798934:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978327296 00000100:00100000:3.0:1790919772.798949:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919772.798957:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978327808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919772.799037:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978327808:12345-0@lo:400:kworker.0 Request processed in 80us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919772.799044:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790919772.799085:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919772.799092:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978327296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919772.799135:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978327296:12345-0@lo:400:kworker.0 Request processed in 44us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919772.799141:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919772.799196:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978327808:0@lo:400:kworker.0 00000020:01000004:0.0:1790919772.800244:0:23942:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790919772.800260:0:23942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff95f3a68799c0) 00000020:00000080:0.0:1790919772.800286:0:23942:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790919772.800361:0:23942:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95f38716e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790919772.800365:0:23942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95f38716e000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790919772.800367:0:23942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95f38716e000 3 00010000:00080000:0.0:1790919772.800405:0:23942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95f285283000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1790919772.805230:0:23942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:1.0:1790919772.806776:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978327424:0@lo:400:kworker.0 00010000:00080000:1.0:1790919772.806796:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f284c0e680 x1877914978328064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919772.806807:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978328064:0@lo:400:kworker.0 00000100:00100000:1.0:1790919772.806819:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978327296:0@lo:400:kworker.0 00010000:00080000:1.0:1790919772.806829:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f284c0ca80 x1877914978327936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919772.806838:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978327936:0@lo:400:kworker.0 00010000:00080000:1.0:1790919772.806884:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3ae84ad80 x1877914978327168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919772.806891:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919772.806899:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790919772.806906:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790919772.806910:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790919772.806914:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3ac514000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919772.806920:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3457:1877914978327168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919772.806944:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919772.806948:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790919772.806952:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790919772.806955:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978327552:0@lo:8:kworker.0 00000020:00000080:3.0:1790919772.807239:0:23942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790919772.807281:0:23942:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790919772.807291:0:23942:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x951c50ad1591534e 00000100:00080000:3.0:1790919772.807297:0:23942:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790919772.807307:0:23942:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff95f285283000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1790919772.807336:0:23942:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f3a0019880 x1877914978328320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790919772.807354:0:23942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790919772.807573:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978328320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790919772.807631:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.807682:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328320 00000100:00100000:1.0:1790919772.807688:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328320 00000100:00100000:1.0:1790919772.807728:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919772.807735:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3457:x1877914978328320:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790919772.807759:0:21904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:1.0:1790919772.807789:0:21904:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x951c50ad15915355 00000004:00100000:1.0:1790919772.807803:0:21904:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790919772.807835:0:21904:0:(import.c:65:import_set_state_nolock()) ffff95f3bce54800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790919772.807882:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3457:x1877914978328320:12345-0@lo:38:llog_process_th.0 Request processed in 146us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.807890:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790919772.807922:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95f3a0019880 x1877914978328320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790919782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919772.807930:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790919772.807935:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790919772.807941:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790919772.807943:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790919772.807945:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f285283000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790919772.807949:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3457:1877914978328320:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790919772.809211:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919772.809218:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790919772.809221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790919772.809224:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790919772.809869:0:23942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790919772.810030:0:23931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790919772.810100:0:23931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790919772.810435:0:23931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591532b expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919772.810447:0:23931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1d000/0x951c50ad15915324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591532b expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790919772.810511:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790919772.810514:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919772.810515:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919772.810516:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919772.810517:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919772.810519:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919772.810525:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919772.810526:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919772.810527:0:23931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790919772.810531:0:23931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790919772.810533:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790919772.810534:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790919772.810534:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790919772.810535:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790919772.810536:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790919772.810537:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790919772.810538:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790919772.810539:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790919772.810540:0:23931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790919772.810563:0:23931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790919772.810583:0:23931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978328448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790919772.810650:0:23931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919772.810679:0:23931:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced300 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.810805:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328448 00000100:00100000:1.0:1790919772.810813:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328448 00000100:00100000:1.0:1790919772.810855:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919772.810863:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:23931:x1877914978328448:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790919772.810891:0:21897:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790919772.810918:0:21897:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790919772.835082:0:21897:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790919772.835098:0:21897:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790919772.835186:0:21919:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790919772.835192:0:21919:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790919772.835213:0:21919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835233:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835242:0:21919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151fe expref: 24 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835250:0:21919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835288:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 24 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835302:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 24 pid: 21896 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.835316:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978328576:0@lo:104: 00000100:00100000:1.0:1790919772.835379:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790919772.835423:0:21919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835448:0:21919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.835457:0:21919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978328704:0@lo:104: 00000100:00100000:1.0:1790919772.835479:0:21919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.835497:0:21919:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3832116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919772.835527:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328576 00000100:00100000:1.0:1790919772.835534:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328576 00000100:00100000:1.0:1790919772.835567:0:21887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328704 00000100:00100000:1.0:1790919772.835570:0:21887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328704 00000100:00100000:1.0:1790919772.835584:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919772.835593:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978328576:12345-0@lo:104: 00010000:00010000:1.0:1790919772.835605:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835653:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919772.835659:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:21919:x1877914978328576:12345-0@lo:104: Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.835667:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919772.835683:0:21887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919772.835689:0:21887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978328704:12345-0@lo:104: 00010000:00010000:1.0:1790919772.835696:0:21887:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835740:0:21887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919772.835745:0:21887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:21919:x1877914978328704:12345-0@lo:104: Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.835761:0:21887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919772.835795:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978328576:0@lo:104: 00000100:00100000:1.0:1790919772.835805:0:21919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21919:1877914978328704:0@lo:104: 00010000:00010000:1.0:1790919772.835822:0:21919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835839:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790919772.835845:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835852:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8a00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919772.835857:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835865:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919772.835873:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919772.835880:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919772.835905:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835913:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919772.835931:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835939:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8a00/0x951c50ad159151fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad15915205 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835957:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919772.835960:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835967:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1ca00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:1.0:1790919772.835971:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.835978:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790919772.835984:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919772.835990:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790919772.836004:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836010:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790919772.836024:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836031:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f382e1ca00/0x951c50ad159151f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151f7 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836044:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919772.836046:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919772.836048:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919772.836077:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919772.836095:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978328832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919772.836124:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.836163:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978328960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790919772.836186:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919772.836231:0:21889:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328832 00000100:00100000:1.0:1790919772.836236:0:21889:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328832 00010000:00010000:1.0:1790919772.836253:0:21889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 25 pid: 21896 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.836272:0:21889:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978328960 00000100:00100000:1.0:1790919772.836275:0:21889:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978328960 00010000:00010000:1.0:1790919772.836284:0:21889:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 26 pid: 21898 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.836295:0:21889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919772.836301:0:21889:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+26:3459:x1877914978328832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919772.836311:0:21889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919772.836315:0:21889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 26 pid: 21896 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836324:0:21889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 26 pid: 21896 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836336:0:21889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a1800/0x951c50ad15915205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159151fe expref: 26 pid: 21896 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836348:0:21889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919772.836375:0:21889:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3459:x1877914978328832:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.836381:0:21889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919772.836400:0:21889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919772.836405:0:21889:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3460:x1877914978328960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919772.836413:0:21889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919772.836417:0:21889:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836426:0:21889:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836435:0:21889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a0600/0x951c50ad159151f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159151f0 expref: 24 pid: 21898 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836446:0:21889:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836453:0:21889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790919772.836465:0:21889:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006425062s 00010000:00010000:1.0:1790919772.836469:0:21889:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836476:0:21889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836483:0:21889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836489:0:21889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836495:0:21889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f382e1cc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919772.836505:0:21889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836513:0:21889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836525:0:21889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836534:0:21889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919772.836562:0:21889:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:3460:x1877914978328960:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919772.836569:0:21889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919772.836599:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978328832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919772.836616:0:21919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836625:0:21919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919772.836632:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1cc00/0x951c50ad1591535c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919772.836654:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978328960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919772.846909:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:23931:x1877914978328448:12345-0@lo:253:mount.lustre.0 Request processed in 36038us (36250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919772.846925:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790919772.847194:0:23931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:23931:1877914978328448:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790919772.847209:0:23931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790919772.847213:0:23931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790919772.847214:0:23931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790919772.847216:0:23931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790919772.847230:0:23931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790919772.847232:0:23931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790919772.847233:0:23931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790919772.847235:0:23931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790919772.847237:0:23931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790919772.847238:0:23931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790919772.847255:0:23931:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790919772.847827:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919772.848010:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919772.848321:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919772.848469:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790919772.848695:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790919772.848878:0:23931:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790919772.849820:0:23931:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1790919772.886172:0:23931:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790919772.886182:0:23931:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790919772.886220:0:23931:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790919772.886273:0:23931:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790919772.886287:0:23931:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1790919772.886314:0:23931:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790919773.277035:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919774.304265:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790919774.624652:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790919774.624658:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f286c1f000 from 14 10000000:01000000:2.0:1790919774.624663:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1790919774.624669:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978329088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790919774.624713:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919774.624725:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919774.624738:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919774.624758:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919774.624759:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919774.624806:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919774.624829:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329088 00000100:00100000:1.0:1790919774.624836:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329088 00000100:00100000:2.0:1790919774.624839:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d31c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790919774.624861:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329216 00000100:00100000:2.0:1790919774.624865:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329216 00000100:00100000:1.0:1790919774.624895:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919774.624903:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919774.624909:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978329088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919774.624916:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978329216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919774.624927:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919774.624942:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0600/0x951c50ad1591536a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915363 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1790919774.624944:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00010000:00010000:2.0:1790919774.624967:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0600/0x951c50ad1591536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915363 expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919774.624991:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0600/0x951c50ad1591536a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915363 expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919774.624995:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978329088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919774.625005:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0600, rc 0) 00000100:00100000:1.0:1790919774.625007:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790919774.625032:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919774.625047:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978329216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919774.625077:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790919774.625091:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978329088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919774.625124:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919774.625139:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591536a expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919774.625148:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad1591536a expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919774.625192:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919774.625223:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919774.625258:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d31c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919774.625796:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329344 00000100:00100000:1.0:1790919774.625803:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329344 00000100:00100000:1.0:1790919774.625845:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919774.625854:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978329344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790919774.625870:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790919774.625887:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790919774.625897:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1790919774.625992:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978329344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919774.626000:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790919774.626037:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790919774.626127:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919774.626135:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591536a expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626143:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a1800/0x951c50ad15915363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad1591536a expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790919774.626152:0:21900:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790919774.626155:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95f3b4169000 from 14 10000000:01000000:1.0:1790919774.626157:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790919774.626178:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626186:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626194:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919774.626210:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790919774.626243:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919774.626260:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390d31c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919774.626275:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329472 00000100:00100000:1.0:1790919774.626278:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329472 00000100:00100000:1.0:1790919774.626309:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919774.626315:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978329472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919774.626323:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919774.626333:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1da00/0x951c50ad15915378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915371 expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626350:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1da00/0x951c50ad15915378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915371 expref: 24 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626360:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1da00/0x951c50ad15915378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915371 expref: 24 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626366:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1da00, rc 0) 00000100:00100000:1.0:1790919774.626399:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978329472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919774.626405:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790919774.626436:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919774.626447:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915378 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.626455:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915378 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919774.628665:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790919774.628741:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919774.628784:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6a6b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919774.628794:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329600 00000100:00100000:2.0:1790919774.628803:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329600 00000100:00100000:2.0:1790919774.628853:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790919774.628862:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978329600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790919774.628894:0:21898:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790919774.628915:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790919774.628918:0:21898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1790919774.629034:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978329600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919774.629149:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978329600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790919774.629162:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 10000000:01000000:1.0:1790919774.629220:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790919774.629228:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915378 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919774.629239:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f382e1c400/0x951c50ad15915371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915378 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.324248:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919775.900257:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919760/real 1790919760] req@ffff95f285ac0700 x1877914978316928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919775.900304:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f285ac0700 x1877914978316928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919775.900315:0:3457:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790919760/real 1790919760] req@ffff95f285ac1c00 x1877914978317056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919775.900326:0:3457:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95f285ac1c00 x1877914978317056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790919775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790919775.900348:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bce52800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790919775.900457:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919775.900463:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978316928:0@lo:8:kworker.0 00000100:00080000:3.0:1790919775.900470:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383fae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790919775.907031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919775.907039:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790919775.907045:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919775.907084:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff95f3903e1000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919775.907113:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e24700 x1877914978330112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919775.907142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919775.907145:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790919775.907147:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f3bce52800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919775.907152:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:2.0:1790919775.907158:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790919775.907163:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff95f3bce52800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919775.907174:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e27100 x1877914978330496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790919775.907183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790919775.907186:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790919775.907188:0:8:0:(import.c:65:import_set_state_nolock()) ffff95f383fae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790919775.907192:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:2.0:1790919775.907195:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790919775.907199:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff95f383fae000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1790919775.907211:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95f382e27800 x1877914978330624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790919775.907283:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978329728:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907376:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907428:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978330368:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907457:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907487:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978331136:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907522:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907551:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790919775.907557:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978329856:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907581:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907599:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978330752:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907621:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907638:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978331264:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907663:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907716:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978329984:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907747:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907766:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978330880:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907788:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907800:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790919775.907806:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978330240:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907827:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907838:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978331008:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.907858:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.907884:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329728 00000100:00100000:2.0:1790919775.907893:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329728 00000100:00100000:2.0:1790919775.907949:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919775.907960:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3458:x1877914978329728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908028:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3458:x1877914978329728:12345-0@lo:400:kworker.0 Request processed in 70us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908037:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790919775.908110:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331136 00000100:00100000:2.0:1790919775.908114:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331136 00000100:00100000:2.0:1790919775.908148:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330752 00000100:00100000:2.0:1790919775.908152:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330752 00000100:00100000:2.0:1790919775.908163:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331264 00000100:00100000:2.0:1790919775.908166:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331264 00000100:00100000:2.0:1790919775.908178:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330880 00000100:00100000:2.0:1790919775.908179:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330880 00000100:00100000:2.0:1790919775.908189:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330240 00000100:00100000:2.0:1790919775.908192:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330240 00000100:00100000:2.0:1790919775.908201:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331008 00000100:00100000:2.0:1790919775.908203:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331008 00000100:00100000:2.0:1790919775.908218:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919775.908225:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978331136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908260:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978331136:12345-0@lo:400:kworker.0 Request processed in 35us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908267:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919775.908280:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919775.908286:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978330752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908315:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978330752:12345-0@lo:400:kworker.0 Request processed in 30us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908322:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790919775.908332:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919775.908338:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978331264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908368:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978331264:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908382:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790919775.908394:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919775.908399:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978330880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908432:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978330880:12345-0@lo:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908438:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790919775.908448:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919775.908453:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978330240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908477:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3460:x1877914978330240:12345-0@lo:400:kworker.0 Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908482:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790919775.908491:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919775.908496:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978331008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908519:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3460:x1877914978331008:12345-0@lo:400:kworker.0 Request processed in 23us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908524:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790919775.908558:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329984 00000100:00100000:2.0:1790919775.908562:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329984 00000100:00100000:2.0:1790919775.908590:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790919775.908597:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978329984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908629:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978329984:12345-0@lo:400:kworker.0 Request processed in 33us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.908636:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790919775.908657:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919775.908662:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790919775.908715:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24000 x1877914978330240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908730:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3460:1877914978330240:0@lo:400:kworker.0 00010000:00080000:2.0:1790919775.908742:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24a80 x1877914978331008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908750:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3460:1877914978331008:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908761:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978329984:0@lo:400:kworker.0 00010000:00080000:2.0:1790919775.908770:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e25f80 x1877914978330880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908779:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978330880:0@lo:400:kworker.0 00010000:00080000:2.0:1790919775.908820:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e25880 x1877914978330752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908828:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978330752:0@lo:400:kworker.0 00010000:00080000:2.0:1790919775.908839:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e27b80 x1877914978331264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908846:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978331264:0@lo:400:kworker.0 00000100:00100000:2.0:1790919775.908854:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978329728:0@lo:400:kworker.0 00010000:00080000:2.0:1790919775.908864:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e25180 x1877914978331136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919775.908873:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978331136:0@lo:400:kworker.0 00000100:00080000:3.0:1790919775.909028:0:3457:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790919775.909035:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978317056:0@lo:8:kworker.0 00000100:00100000:3.0:1790919775.909084:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330368 00000100:00100000:3.0:1790919775.909090:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330368 00000100:00100000:3.0:1790919775.909121:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978329856 00000100:00100000:3.0:1790919775.909124:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978329856 00000100:00100000:3.0:1790919775.909138:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919775.909145:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978330368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919775.909196:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978330368:12345-0@lo:400:kworker.0 Request processed in 52us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919775.909214:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790919775.909228:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919775.909233:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978329856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919775.909264:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978329856:12345-0@lo:400:kworker.0 Request processed in 30us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919775.909270:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790919775.909307:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978329856:0@lo:400:kworker.0 00000100:00100000:3.0:1790919775.909318:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978330368:0@lo:400:kworker.0 00000100:00100000:3.0:1790919775.909339:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978330112:0@lo:8:kworker.0 00000100:00100000:3.0:1790919775.909378:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919775.909411:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330112 00000100:00100000:3.0:1790919775.909415:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330112 00000100:00100000:3.0:1790919775.909436:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919775.909441:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3457:x1877914978330112:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790919775.909474:0:23209:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:3.0:1790919775.909507:0:23209:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x951c50ad1591537f 00002000:00100000:3.0:1790919775.909523:0:23209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff95f3ac512000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790919775.909528:0:23209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790919775.909531:0:23209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790919775.909952:0:23209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790919775.909983:0:23209:0:(import.c:65:import_set_state_nolock()) ffff95f3ac511000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790919775.910027:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3457:x1877914978330112:12345-0@lo:8:kworker.0 Request processed in 583us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919775.910035:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790919775.910110:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e24700 x1877914978330112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790919775.910125:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790919775.910134:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790919775.910140:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790919775.910142:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3903e1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790919775.910164:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790919775.910170:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3457:1877914978330112:0@lo:8:kworker.0 00000004:00080000:3.0:1790919775.910214:0:21930:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790919775.910233:0:21930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21930:1877914978331520:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790919775.910259:0:21930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919775.910276:0:21930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790919775.910289:0:23210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331520 00000100:00100000:3.0:1790919775.910293:0:23210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331520 00000100:00100000:3.0:1790919775.910321:0:23210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919775.910328:0:23210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21930:x1877914978331520:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790919775.912334:0:23210:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790919775.912347:0:23210:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1790919775.912352:0:23210:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:0.0:1790919775.913100:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790919775.913128:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978331392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919775.913217:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790919775.913286:0:21929:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790919775.913732:0:21929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584941677854ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790919775.913783:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331392 00000100:00100000:0.0:1790919775.913792:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331392 00000100:00100000:0.0:1790919775.913850:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790919775.913861:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1877914978331392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919775.913907:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919775.913983:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3461:x1877914978331392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.913992:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790919775.914043:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a001bb80 x1877914978331392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919775.914092:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978331392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919775.919872:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978330496:0@lo:8:kworker.0 00000100:00100000:2.0:1790919775.920001:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.920091:0:3457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978330624:0@lo:8:kworker.0 00000100:00100000:2.0:1790919775.920119:0:3457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790919775.922244:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790919775.932238:0:23209:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919775.932257:0:23209:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790919775.932285:0:23212:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919775.932295:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330496 00000100:00100000:2.0:1790919775.932308:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330496 00000100:00100000:2.0:1790919775.932342:0:23212:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790919775.932347:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978330624 00000100:00100000:2.0:1790919775.932350:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978330624 00000100:00100000:2.0:1790919775.932714:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919775.932725:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3457:x1877914978330496:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790919775.932766:0:24150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:2.0:1790919775.932802:0:24150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad15915386 00002000:00100000:2.0:1790919775.932824:0:24150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff95f286c1a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790919775.932830:0:24150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790919775.932834:0:24150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790919775.933143:0:24150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790919775.933180:0:24150:0:(import.c:65:import_set_state_nolock()) ffff95f285da1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919775.933300:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978330496:12345-0@lo:8:kworker.0 Request processed in 573us (13297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.933310:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919775.933333:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919775.933338:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3457:x1877914978330624:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790919775.933361:0:24150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:2.0:1790919775.933378:0:24150:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x951c50ad1591538d 00002000:00100000:2.0:1790919775.933393:0:24150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff95f284bd2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790919775.933396:0:24150:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790919775.933398:0:24150:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790919775.933452:0:24150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790919775.933773:0:24150:0:(import.c:65:import_set_state_nolock()) ffff95f2868ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919775.933815:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3457:x1877914978330624:12345-0@lo:8:kworker.0 Request processed in 475us (13694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.933822:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919775.933967:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919775.933980:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790919775.933990:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790919775.933996:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790919775.934000:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f3bce52800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790919775.934025:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790919775.934032:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978330496:0@lo:8:kworker.0 00010000:00080000:0.0:1790919775.934076:0:3457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e27800 x1877914978330624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790919795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919775.934087:0:3457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790919775.934092:0:3457:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790919775.934097:0:3457:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790919775.934100:0:3457:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790919775.934102:0:3457:0:(import.c:65:import_set_state_nolock()) ffff95f383fae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790919775.934117:0:3457:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790919775.934120:0:3457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3457:1877914978330624:0@lo:8:kworker.0 00000004:00080000:0.0:1790919775.934157:0:22545:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790919775.934600:0:22545:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 584962546228ns, next at 0ns, rc = 0 00000004:00080000:0.0:1790919775.934666:0:22548:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790919775.934706:0:22548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978331776:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790919775.934771:0:22548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919775.934804:0:22548:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390edb600 going to sleep for 11 seconds 00000004:00080000:0.0:1790919775.934823:0:22547:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790919775.935091:0:22547:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 584963037812ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790919775.935139:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978331648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919775.935172:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919775.935217:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331776 00000100:00100000:0.0:1790919775.935226:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331776 00000100:00100000:0.0:1790919775.935284:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919775.935294:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22548:x1877914978331776:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790919775.937108:0:22546:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790919775.937144:0:22546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332032:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790919775.937219:0:22546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.937253:0:22546:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919775.939514:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331648 00000100:00100000:0.0:1790919775.939532:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331648 00000100:00100000:0.0:1790919775.939594:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919775.939606:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3461:x1877914978331648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790919775.939640:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919775.939760:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3461:x1877914978331648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.939768:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790919775.939800:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919775.939820:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978331904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790919775.939866:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919775.939935:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978331904 00000100:00100000:0.0:1790919775.939939:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978331904 00000100:00100000:0.0:1790919775.939963:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919775.939971:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978331904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790919775.939983:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1790919775.940020:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978331904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.940041:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790919775.940084:0:23209:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790919775.940093:0:23209:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:0.0:1790919775.940295:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0ed80 x1877914978331648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790919791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919775.940322:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978331648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790919775.940362:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3b4317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978331904:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1790919775.941523:0:23212:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1790919775.941532:0:23212:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1790919775.941623:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22548:x1877914978331776:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6328us (6850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.941635:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790919775.941710:0:22548:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f284c0d180 x1877914978331776/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790919791 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919775.941724:0:22548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978331776:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1790919775.941740:0:22548:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1790919775.941787:0:22548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978332160:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790919775.941825:0:22548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919775.941844:0:22548:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390edb600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919775.941865:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332032 00000100:00100000:0.0:1790919775.941872:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332032 00000100:00100000:0.0:1790919775.941902:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332160 00000100:00100000:0.0:1790919775.941906:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332160 00000100:00100000:0.0:1790919775.941921:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919775.941929:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22546:x1877914978332032:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1790919775.942232:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790919775.942240:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1790919775.945330:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.945345:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.945366:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.945371:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.945379:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.945410:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.945423:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.945433:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.945455:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919775.945984:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.945992:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946004:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.946008:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.946013:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946024:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946032:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946092:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946115:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919775.946132:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919775.946140:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946149:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.946155:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946166:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946188:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946196:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1db55a/0x951c50ad15915394 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946215:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.946218:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946237:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ce00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.946241:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946250:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946261:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946268:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc6d94e/0x951c50ad1591539b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.946280:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.946282:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.946284:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.947647:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.947659:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.947677:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.947682:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.947687:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.947712:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.947734:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.947743:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.947770:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919775.947777:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919775.947785:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.947793:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919775.947798:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.947807:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.947825:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.947832:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de46110d/0x951c50ad159153a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.948046:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.948048:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.948067:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.948343:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.948351:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948362:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.948366:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.948371:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948382:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948391:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948399:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948427:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.948437:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.948442:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948450:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.948454:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948462:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948475:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948483:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7a2ac7/0x951c50ad159153a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948496:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.948497:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.948499:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.948902:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.948910:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948920:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.948929:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.948934:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948943:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948950:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948957:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.948981:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919775.948991:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919775.948996:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.949005:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2de00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919775.949009:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.949018:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.949030:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.949038:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca6efbc9/0x951c50ad159153b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.949076:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.949078:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.949080:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.949470:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.949478:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949487:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.949491:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.949496:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949506:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949516:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949528:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949546:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.949556:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.949561:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949569:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.949573:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949581:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949594:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949602:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d999e7d/0x951c50ad159153b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.949616:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.949617:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.949619:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.950028:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.950041:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950076:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.950081:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.950085:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950096:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950104:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950112:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950132:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790919775.950175:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790919775.950181:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.950200:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2d400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919775.950205:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.950213:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.950225:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.950233:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee66df93/0x951c50ad159153be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919775.950248:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.950250:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919775.950251:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.950510:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.950517:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950527:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.950531:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.950535:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950546:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950560:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950568:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950582:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.950592:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.950597:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950604:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.950608:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950616:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950627:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950635:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080f62c9d/0x951c50ad159153c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.950650:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.950657:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.950659:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919775.951464:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790919775.954801:0:23212:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1790919775.954813:0:23212:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790919775.954948:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22546:x1877914978332032:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13014us (17723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.954961:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790919775.955006:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919775.955022:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22548:x1877914978332160:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790919775.955088:0:23212:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1790919775.955125:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22548:x1877914978332160:12345-0@lo:5:osp-pre-1-1.0 Request processed in 110us (13299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919775.955131:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790919775.955191:0:22548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978332160:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790919775.955207:0:22548:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1790919775.955261:0:22548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978332288:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1790919775.955299:0:22548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919775.955325:0:22548:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f390edb600 going to sleep for 11 seconds 00000100:00100000:0.0:1790919775.955340:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332288 00000100:00100000:0.0:1790919775.955347:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332288 00000100:00100000:0.0:1790919775.955377:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919775.955383:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22548:x1877914978332288:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790919775.955419:0:23212:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:2.0:1790919775.956485:0:22546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332032:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1790919775.956503:0:22546:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790919775.956537:0:22546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332416:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790919775.956587:0:22546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919775.956604:0:22546:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f285798cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790919775.956636:0:24150:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1790919775.956647:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332416 00000100:00100000:2.0:1790919775.956652:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332416 00002000:00010000:3.0:1790919775.959177:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.959194:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959217:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.959222:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.959230:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959247:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959259:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959269:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959298:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919775.959741:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.959753:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959763:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.959767:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.959772:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959791:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959800:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959808:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959824:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919775.959837:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919775.959844:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959853:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.959859:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959870:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959890:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959899:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad159153cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959926:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.959929:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959935:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.959938:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959945:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959955:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959962:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad159153d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.959974:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.959976:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.959978:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.960445:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.960452:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960461:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.960471:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.960476:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960486:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960495:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960503:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960518:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.960529:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.960534:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960541:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdea00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.960545:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960554:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960565:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960583:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad159153da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.960597:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.960600:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.960602:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.961264:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.961797:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.961807:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.961822:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.961827:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.961833:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.961846:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.961855:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.961864:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.961970:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919775.962524:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.962537:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.962548:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.962552:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.962556:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.962567:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.962575:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.962583:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962686:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790919775.962706:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962715:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdfa00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.962720:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962738:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962761:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962769:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009efad6c6/0x951c50ad159153e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962791:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919775.962794:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962801:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.962804:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962812:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962822:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.962831:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.962833:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.962841:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.963044:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919775.963085:0:23210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad159153e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919775.963607:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.963616:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.963628:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.963632:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.963644:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.963656:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.963665:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.963674:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.963777:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919775.963784:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.963793:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.963797:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.963805:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.963817:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.964045:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.964048:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.964050:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.964297:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790919775.964303:0:23210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad159153ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790919775.964847:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.964855:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964866:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.964871:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.964876:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964888:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964911:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964918:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964938:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.964952:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.964958:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964966:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.964972:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964982:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.964997:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965004:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad159153f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965019:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.965026:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.965028:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.965531:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.965538:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965547:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.965551:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.965555:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965565:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965573:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965581:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.965594:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790919775.966189:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.966196:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966206:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1790919775.966209:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.966213:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966229:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966238:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966245:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966258:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790919775.966270:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790919775.966276:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966284:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.966288:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966297:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966312:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966320:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad159153fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966345:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.966349:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966356:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdec00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.966359:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966368:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966379:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966386:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915404 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.966398:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.966400:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.966402:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919775.966564:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919775.966583:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22546:x1877914978332416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790919775.966629:0:24151:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1790919775.966766:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22546:x1877914978332416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 189us (10177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919775.966783:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919775.966847:0:22546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332416:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790919775.966866:0:22546:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790919775.966932:0:22546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332544:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790919775.966979:0:22546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919775.967006:0:22546:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919775.967026:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332544 00000100:00100000:3.0:1790919775.967033:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332544 00000100:00100000:3.0:1790919775.967088:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919775.967095:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22546:x1877914978332544:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790919775.967132:0:24150:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:2.0:1790919775.967835:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.967993:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790919775.975870:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790919775.983776:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.983797:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983821:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.983827:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.983835:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983856:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983868:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983890:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983916:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.983935:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.983944:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983953:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdec00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.983959:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983969:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983990:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.983998:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad1591540b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.984021:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.984023:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.984025:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.984961:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.984979:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.984993:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.984998:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.985004:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985015:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985024:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985032:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985080:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.985094:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.985101:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985109:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.985115:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985124:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985145:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985153:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915412 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.985174:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.985177:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.985179:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.990938:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.990956:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.990977:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.990982:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.990990:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.991007:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.991018:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.991028:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.991093:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919775.991102:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919775.991112:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.991123:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdec00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.991128:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.991152:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.991174:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.991182:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec91f00/0x951c50ad15915419 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.991209:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.991213:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.991216:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919775.991647:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:22546:x1877914978332544:12345-0@lo:5:osp-pre-0-1.0 Request processed in 24547us (24663us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1790919775.991660:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790919775.991788:0:22546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22546:1877914978332544:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790919775.991811:0:22546:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1790919775.991980:0:22546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22546:1877914978332672:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790919775.992034:0:22546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919775.992099:0:22546:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f39105b780 going to sleep for 11 seconds 00000100:00100000:2.0:1790919775.992133:0:21915:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332672 00000100:00100000:2.0:1790919775.992143:0:21915:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332672 00000100:00100000:2.0:1790919775.992202:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790919775.992215:0:21915:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22546:x1877914978332672:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790919775.992281:0:21915:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22546:x1877914978332672:12345-0@lo:900:osp-pre-0-1.0 Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919775.992289:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790919775.992468:0:22546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a0018380 x1877914978332672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919791 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919775.992483:0:22546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22546:1877914978332672:0@lo:900:osp-pre-0-1.0 00002000:00010000:3.0:1790919775.993016:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.993027:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993044:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.993049:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.993113:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993129:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993140:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993162:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993183:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919775.993198:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919775.993205:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993213:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919775.993219:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993229:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993247:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993254:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915420 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.993327:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.993329:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919775.993332:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790919775.994020:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1790919775.994091:0:7248:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00010000:3.0:1790919775.994715:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.994726:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.994743:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.994748:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.994754:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.994767:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.994777:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.994785:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.994809:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919775.994916:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919775.994926:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.994950:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.994955:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.994965:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.994982:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.994992:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51fe46f/0x951c50ad15915427 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.995017:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.995019:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.995022:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919775.998116:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919775.998132:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.998153:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919775.998158:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919775.998166:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.998195:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.998206:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.998215:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919775.998243:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790919775.998260:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919775.998271:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.998281:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919775.998287:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.998299:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.998328:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.998336:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f64de01/0x951c50ad1591542e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919775.998375:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.998378:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919775.998382:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919776.000326:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:22548:x1877914978332288:12345-0@lo:5:osp-pre-1-1.0 Request processed in 44930us (45014us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790919776.000347:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790919776.000393:0:22548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22548:1877914978332288:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790919776.000418:0:22548:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1790919776.000488:0:22548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22548:1877914978332800:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790919776.000542:0:22548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919776.000585:0:22548:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919776.000614:0:21915:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332800 00000100:00100000:1.0:1790919776.000640:0:21915:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332800 00000100:00100000:1.0:1790919776.000712:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790919776.000724:0:21915:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22548:x1877914978332800:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790919776.000804:0:21915:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22548:x1877914978332800:12345-0@lo:900:osp-pre-1-1.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919776.000814:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790919776.000859:0:22548:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f285ac0a80 x1877914978332800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790919792 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919776.000874:0:22548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22548:1877914978332800:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1790919776.001782:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.001799:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001817:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.001823:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.001829:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001844:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001855:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001881:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001906:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790919776.001925:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790919776.001932:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001941:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919776.001945:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001953:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001972:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.001979:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208c3577/0x951c50ad15915435 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.002546:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919776.002551:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919776.002553:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.004116:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.004136:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.004149:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.004154:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.004159:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.004173:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.004183:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.004192:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.004221:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.004270:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.004285:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.004299:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdea00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.004306:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.004319:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.004351:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.004358:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a82f5b/0x951c50ad1591543c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.004389:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.004390:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.004392:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.004978:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.004987:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005098:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.005102:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.005107:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005118:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005133:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005140:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005159:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.005240:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.005249:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.005261:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.005265:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.005291:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.005306:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.005313:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b26b26/0x951c50ad15915443 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.005333:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.005335:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.005337:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.005886:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.005894:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005904:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.005907:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.005911:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005920:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005927:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005933:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.005963:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.006577:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.006587:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.006599:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf600 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.006604:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.006614:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.006632:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.006655:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224a423b/0x951c50ad1591544a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.006679:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.006681:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.006683:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.009265:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.009282:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.009302:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.009308:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.009314:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.009329:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.009340:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.009349:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.009375:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.009406:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.009421:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.009437:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.009444:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.009528:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.009557:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.009566:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f6dd61/0x951c50ad15915451 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.009609:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.009613:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.009615:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.010264:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.010273:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.010284:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.010296:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.010300:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.010310:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.010319:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.010327:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.010349:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.010414:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.010422:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.010433:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdee00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.010439:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.010449:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.010526:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.010535:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008053b088/0x951c50ad15915458 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.010570:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.010574:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.010577:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.010900:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.011034:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011045:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.011049:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.011096:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011107:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011243:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011259:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011279:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.011370:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.011379:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.011390:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.011395:0:21892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.011424:0:21892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.011441:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.011449:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ab5a89/0x951c50ad1591545f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.011547:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.011550:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.011555:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.011841:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.011849:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011860:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.011863:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.011868:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011878:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011885:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.011893:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012040:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.012165:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.012173:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012187:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde000 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.012191:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012200:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012214:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012238:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044f2eaf6/0x951c50ad15915466 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012263:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.012268:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.012270:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790919776.012766:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790919776.012774:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012793:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=585s v=(0 0) 00010000:00010000:3.0:1790919776.012797:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919776.012801:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012812:0:23210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012821:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012828:0:23210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919776.012849:0:23210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790919776.012911:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919776.012919:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012929:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdfc00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919776.012933:0:21893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012942:0:21893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012957:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012964:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a873697/0x951c50ad1591546d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919776.012985:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.012987:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919776.012988:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790919776.014462:0:23210:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1790919776.014633:0:23210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21930:x1877914978331520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104300us (104368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919776.014644:0:23210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919776.014747:0:21930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21930:1877914978331520:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790919776.014774:0:21930:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1790919776.014845:0:21930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21930:1877914978332928:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790919776.014910:0:21930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919776.014957:0:21930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b5f00b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919776.015035:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978332928 00000100:00100000:3.0:1790919776.015044:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978332928 00000100:00100000:3.0:1790919776.015416:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790919776.015427:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:21930:x1877914978332928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790919776.015483:0:23209:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790919776.018632:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:21930:x1877914978332928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3197us (3712us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790919776.018656:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919776.018700:0:21930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f285ac0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21930:1877914978332928:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790919776.018720:0:21930:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1790919776.156542:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919776.157338:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978333184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919776.157453:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919776.157524:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333184 00000100:00100000:3.0:1790919776.157535:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333184 00000100:00100000:3.0:1790919776.157589:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919776.157600:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978333184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919776.157656:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919776.157727:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a001b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978333184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919776.157735:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919776.157794:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978333184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790919776.159831:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978333056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919776.159925:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919776.164294:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333056 00000100:00100000:1.0:1790919776.164316:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333056 00000100:00100000:1.0:1790919776.164406:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790919776.164420:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978333056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919776.164486:0:21908:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919776.164643:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978333056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919776.164652:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919776.164797:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978333056:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790919776.348205:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790919777.372225:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790919777.773484:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1790919777.773502:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:02000400:3.0:1790919777.908256:0:24293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:3.0:1790919778.290409:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1790919778.290428:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1790919778.290433:0:9048:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:3.0:1790919778.290474:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790919778.399157:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919779.420147:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919779.695521:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.695707:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312064 00000100:00100000:2.0:1790919779.695718:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312064 00000100:00100000:2.0:1790919779.695779:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:2.0:1790919779.695797:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2410:x1877914958312064:12345-192.168.203.11@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790919779.695827:0:21898:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5848b4d0-1c03-47ed-8ac4-acdef81976e5@192.168.203.11@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:2.0:1790919779.695856:0:21898:0:(genops.c:1384:class_connect()) connect: client 5848b4d0-1c03-47ed-8ac4-acdef81976e5, cookie 0x951c50ad15915474 00000100:00080000:2.0:1790919779.696003:0:21898:0:(import.c:65:import_set_state_nolock()) ffff95f2868ee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919779.696122:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+5:2410:x1877914958312064:12345-192.168.203.11@tcp:250:mount.lustre.0 Request processed in 333us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.696131:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1790919779.706614:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.706934:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312192 00000100:00100000:2.0:1790919779.706944:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312192 00000100:00100000:2.0:1790919779.706999:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1790919779.707010:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+5:18298:x1877914958312192:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790919779.707027:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919779.707045:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0000/0x951c50ad1591547b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39156 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919779.707120:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0000/0x951c50ad1591547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39156 expref: 6 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919779.707139:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0000/0x951c50ad1591547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39156 expref: 6 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919779.707148:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0000, rc 0) 00000100:00100000:2.0:1790919779.707206:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+6:18298:x1877914958312192:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 197us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.707214:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1790919779.711978:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.712090:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312320 00000100:00100000:1.0:1790919779.712102:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312320 00000100:00100000:1.0:1790919779.712165:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1790919779.712174:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+6:18298:x1877914958312320:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919779.712497:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+6:18298:x1877914958312320:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 322us (526us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790919779.712506:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1790919779.715014:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.715132:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312448 00000100:00100000:0.0:1790919779.715141:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312448 00000100:00100000:0.0:1790919779.715192:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:0.0:1790919779.715201:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+6:18298:x1877914958312448:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919779.715217:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919779.715233:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1a00/0x951c50ad15915482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3915d expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.715259:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1a00/0x951c50ad15915482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3915d expref: 7 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.715270:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1a00/0x951c50ad15915482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3915d expref: 7 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.715279:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1a00, rc 0) 00000100:00100000:0.0:1790919779.715335:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+7:18298:x1877914958312448:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 134us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.715342:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:0.0:1790919779.725578:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.726085:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312576 00000100:00100000:1.0:1790919779.726096:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312576 00000100:00100000:1.0:1790919779.726159:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790919779.726169:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+7:18298:x1877914958312576:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919779.726497:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18298:x1877914958312576:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 327us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919779.726506:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1790919779.728546:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.729848:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312704 00000100:00100000:2.0:1790919779.729860:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312704 00000100:00100000:2.0:1790919779.729924:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:2.0:1790919779.729934:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18298:x1877914958312704:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790919779.733123:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18298:x1877914958312704:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 3180us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.733138:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1790919779.740392:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790919779.740416:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978333312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919779.740485:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919779.741140:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333312 00000100:00100000:1.0:1790919779.741217:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333312 00000100:00100000:1.0:1790919779.741345:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790919779.741354:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a0018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978333312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919779.741389:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919779.741502:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a0018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978333312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919779.741510:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790919779.741560:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919779.741597:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978333312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919779.746725:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.746893:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312832 00000100:00100000:0.0:1790919779.746905:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312832 00000100:00100000:0.0:1790919779.746966:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1790919779.746977:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958312832:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919779.747387:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958312832:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 411us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.747396:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:0.0:1790919779.766952:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.767087:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958312960 00000100:00100000:2.0:1790919779.767097:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958312960 00000100:00100000:2.0:1790919779.767143:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:2.0:1790919779.767154:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958312960:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919779.767478:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958312960:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 325us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.767486:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:2.0:1790919779.775897:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.776440:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313088 00000100:00100000:1.0:1790919779.776451:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313088 00000100:00100000:1.0:1790919779.776549:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:1.0:1790919779.776561:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958313088:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919779.776874:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18317:x1877914958313088:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 314us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919779.776890:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:1.0:1790919779.781972:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.782096:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313216 00000100:00100000:0.0:1790919779.782106:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313216 00000100:00100000:0.0:1790919779.782251:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790919779.782262:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+8:18298:x1877914958313216:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919779.782280:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919779.782299:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1e00/0x951c50ad15915489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3918e expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.782327:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1e00/0x951c50ad15915489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3918e expref: 9 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.782338:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1e00/0x951c50ad15915489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3918e expref: 9 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.782347:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1e00, rc 0) 00000100:00100000:0.0:1790919779.782397:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+9:18298:x1877914958313216:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 138us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.782402:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1790919779.784753:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.784848:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313344 00000100:00100000:1.0:1790919779.784856:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313344 00000100:00100000:1.0:1790919779.784902:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1790919779.784909:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+9:18298:x1877914958313344:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790919779.784931:0:21898:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790919779.784955:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790919779.784959:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790919779.784963:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790919779.784966:0:21898:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790919779.784969:0:21898:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790919779.787408:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+9:18298:x1877914958313344:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 2490us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.787419:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:3.0:1790919779.789637:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.789750:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313472 00000100:00100000:0.0:1790919779.789764:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313472 00000100:00100000:0.0:1790919779.789816:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:0.0:1790919779.789826:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+9:18298:x1877914958313472:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919779.789851:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919779.789868:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39195 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.789895:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 10 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.789906:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 10 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919779.789915:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1800, rc 0) 00000100:00100000:0.0:1790919779.789974:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18298:x1877914958313472:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 150us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.789980:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:0.0:1790919779.791647:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.791719:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313600 00000100:00100000:2.0:1790919779.791726:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313600 00000100:00100000:2.0:1790919779.791765:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:2.0:1790919779.791774:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18298:x1877914958313600:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790919779.792007:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18298:x1877914958313600:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 234us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.792015:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1790919779.793509:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.793569:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313728 00000100:00100000:0.0:1790919779.793575:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313728 00000100:00100000:0.0:1790919779.793611:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1790919779.793619:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18298:x1877914958313728:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790919779.793957:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18298:x1877914958313728:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 338us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.793962:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1790919779.796035:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.796128:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313856 00000100:00100000:2.0:1790919779.796136:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313856 00000100:00100000:2.0:1790919779.796246:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:2.0:1790919779.796256:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18322:x1877914958313856:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919779.796688:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18322:x1877914958313856:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 433us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.796704:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1790919779.798467:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.798564:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958313984 00000100:00100000:1.0:1790919779.798573:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958313984 00000100:00100000:1.0:1790919779.798623:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1790919779.798632:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18322:x1877914958313984:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919779.798919:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18322:x1877914958313984:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 287us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919779.798928:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1790919779.803773:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919779.804101:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314112 00000100:00100000:2.0:1790919779.804112:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314112 00000100:00100000:2.0:1790919779.804154:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919779.804162:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2410:x1877914958314112:12345-192.168.203.11@tcp:38:mount.lustre.0 00000100:00100000:1.0:1790919779.804164:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00080000:2.0:1790919779.804189:0:21905:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ac371f0a-d44f-4a58-a70e-41d5105704e6@192.168.203.11@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:2.0:1790919779.804237:0:21905:0:(genops.c:1384:class_connect()) connect: client ac371f0a-d44f-4a58-a70e-41d5105704e6, cookie 0x951c50ad15915497 00000004:00100000:2.0:1790919779.804266:0:21905:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919779.804631:0:21905:0:(import.c:65:import_set_state_nolock()) ffff95f2868ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919779.804724:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2410:x1877914958314112:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 561us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.804732:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919779.804750:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314368 00000100:00100000:2.0:1790919779.804754:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314368 00000100:00100000:2.0:1790919779.804768:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1790919779.804773:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2410:x1877914958314368:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790919779.804789:0:21905:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ac371f0a-d44f-4a58-a70e-41d5105704e6@192.168.203.11@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:2.0:1790919779.804819:0:21905:0:(genops.c:1384:class_connect()) connect: client ac371f0a-d44f-4a58-a70e-41d5105704e6, cookie 0x951c50ad1591549e 00000004:00100000:2.0:1790919779.804836:0:21905:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919779.805085:0:21905:0:(import.c:65:import_set_state_nolock()) ffff95f2868e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919779.805112:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2410:x1877914958314368:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 338us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919779.805119:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1790919779.811306:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919779.811357:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.814164:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.815030:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314624 00000100:00100000:0.0:1790919779.815041:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314624 00000100:00100000:0.0:1790919779.815135:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314240 00000100:00100000:0.0:1790919779.815139:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314240 00000100:00100000:0.0:1790919779.815153:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314496 00000100:00100000:0.0:1790919779.815155:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314496 00000100:00100000:0.0:1790919779.815193:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790919779.815202:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18298:x1877914958314624:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919779.815248:0:21905:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919779.815337:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18298:x1877914958314624:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 135us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.815345:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1790919779.815365:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790919779.815372:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:0:x1877914958314240:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919779.815383:0:21905:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790919779.815406:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:0:x1877914958314240:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 35us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.815413:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1790919779.815425:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919779.815432:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:0:x1877914958314496:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790919779.815451:0:21905:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790919779.815490:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:0:x1877914958314496:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 58us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.815496:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:1.0:1790919779.815928:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790919779.815933:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919779.822291:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919779.822416:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314752 00000100:00100000:0.0:1790919779.822426:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314752 00000100:00100000:0.0:1790919779.822547:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919779.822558:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958314752:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790919779.822651:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958314752:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.822690:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1790919779.825381:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919779.825418:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919779.825482:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.826644:0:21915:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315136 00000100:00100000:0.0:1790919779.826644:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958314880 00000100:00100000:0.0:1790919779.826656:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958314880 00000100:00100000:1.0:1790919779.826674:0:21915:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315136 00000100:00100000:0.0:1790919779.826701:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315008 00000100:00100000:0.0:1790919779.826704:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315008 00000100:00100000:1.0:1790919779.826723:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919779.826723:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790919779.826731:0:21915:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958315136:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790919779.826731:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1877914958314880:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790919779.826759:0:23212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ac371f0a-d44f-4a58-a70e-41d5105704e6@192.168.203.11@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:0.0:1790919779.826787:0:23212:0:(genops.c:1384:class_connect()) connect: client ac371f0a-d44f-4a58-a70e-41d5105704e6, cookie 0x951c50ad159154a5 00002000:00100000:0.0:1790919779.826798:0:23212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac371f0a-d44f-4a58-a70e-41d5105704e6/ffff95f285285000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1790919779.826804:0:21915:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958315136:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 74us (1323us total) trans 0 rc 0/0 00002000:00100000:0.0:1790919779.826809:0:23212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790919779.826811:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00080000:0.0:1790919779.827162:0:23212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790919779.827190:0:23212:0:(import.c:65:import_set_state_nolock()) ffff95f285281800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919779.827220:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2410:x1877914958314880:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 488us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.827227:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790919779.827243:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1790919779.827247:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2410:x1877914958315008:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790919779.827264:0:23212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ac371f0a-d44f-4a58-a70e-41d5105704e6@192.168.203.11@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:0.0:1790919779.827281:0:23212:0:(genops.c:1384:class_connect()) connect: client ac371f0a-d44f-4a58-a70e-41d5105704e6, cookie 0x951c50ad159154ac 00002000:00100000:0.0:1790919779.827287:0:23212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac371f0a-d44f-4a58-a70e-41d5105704e6/ffff95f285287000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790919779.827301:0:23212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790919779.827500:0:23212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790919779.827515:0:23212:0:(import.c:65:import_set_state_nolock()) ffff95f285281000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790919779.827551:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2410:x1877914958315008:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 301us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919779.827558:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1790919779.829859:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919779.829972:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315264 00000100:00100000:1.0:1790919779.829981:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315264 00000100:00100000:1.0:1790919779.830032:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790919779.830042:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958315264:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790919779.833335:0:21906:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3183us 00000004:00200000:3.0:1790919779.840602:0:21906:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790919779.840737:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18298:x1877914958315264:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 10692us (10880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919779.840752:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790919780.011564:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919780.011722:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315392 00000100:00100000:1.0:1790919780.011745:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315392 00000100:00100000:1.0:1790919780.011812:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1790919780.011822:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18345:x1877914958315392:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1790919780.011845:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919780.011873:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159154b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f391c6 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.011943:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.011957:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.011972:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919780.012027:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919780.012031:0:21904:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919780.012214:0:21904:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.012241:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1d600/0x951c50ad159154b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391c6 expref: 8 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.012260:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391c6 expref: 7 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919780.012269:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:1.0:1790919780.012272:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919780.012276:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1c200, rc 0) 00000100:00100000:1.0:1790919780.012340:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18345:x1877914958315392:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 519us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919780.012348:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:3.0:1790919780.444333:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790919780.893228:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919781.276744:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978333568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790919781.276816:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919781.276880:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790919781.276899:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978333440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919781.276924:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.277115:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333568 00000100:00100000:1.0:1790919781.277123:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333568 00000100:00100000:1.0:1790919781.277179:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333440 00000100:00100000:1.0:1790919781.277182:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333440 00000100:00100000:1.0:1790919781.277199:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919781.277207:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978333568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790919781.277263:0:21908:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790919781.277316:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978333568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.277338:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790919781.277354:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919781.277359:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978333440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790919781.277379:0:21908:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919781.277407:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978333440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.277413:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919781.277431:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978333696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919781.277459:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.277491:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333696 00000100:00100000:1.0:1790919781.277495:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333696 00000100:00100000:1.0:1790919781.277527:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790919781.277534:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978333696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919781.277555:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919781.277595:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3460:x1877914978333696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.277601:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790919781.277616:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790919781.277639:0:3460:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1790919781.277686:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3460:1877914978333696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790919781.277719:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978333440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919781.277731:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978333568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919781.277896:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978333824:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.277935:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.277968:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978334336:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.277992:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278008:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978334848:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278030:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278080:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790919781.278086:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978334208:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278107:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278124:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978334720:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278145:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278175:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978334080:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278203:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278223:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978334592:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278248:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278262:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790919781.278270:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978333952:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278334:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919781.278353:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333824 00000100:00100000:1.0:1790919781.278358:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978334464:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278382:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278393:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978334976:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278412:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.278433:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334848 00000100:00100000:1.0:1790919781.278436:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334848 00000100:00080000:1.0:1790919781.278453:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919781.278476:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334208 00000100:00100000:1.0:1790919781.278484:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334208 00000100:00100000:1.0:1790919781.278499:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334720 00000100:00100000:1.0:1790919781.278502:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334720 00000100:00080000:1.0:1790919781.278513:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919781.278522:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334592 00000100:00100000:1.0:1790919781.278525:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334592 00000100:00080000:1.0:1790919781.278535:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919781.278544:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334464 00000100:00100000:1.0:1790919781.278547:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334464 00000100:00100000:1.0:1790919781.278555:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334976 00000100:00100000:1.0:1790919781.278557:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334976 00000100:00080000:1.0:1790919781.278566:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790919781.278579:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919781.278585:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978334848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278626:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3461:x1877914978334848:12345-0@lo:400:kworker.0 Request processed in 40us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.278632:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790919781.278672:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3461:1877914978334848:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278691:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790919781.278698:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919781.278714:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333824 00000100:00100000:1.0:1790919781.278736:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978334208:12345-0@lo:400:kworker.0 Request processed in 37us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.278742:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790919781.278759:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790919781.278769:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3461:x1877914978333824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278776:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978334208:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278797:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790919781.278805:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978334720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919781.278818:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3461:x1877914978333824:12345-0@lo:400:kworker.0 Request processed in 50us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919781.278826:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790919781.278844:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978334720:12345-0@lo:400:kworker.0 Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.278859:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790919781.278887:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790919781.278894:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278928:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3459:x1877914978334592:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.278933:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790919781.278948:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790919781.278959:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278962:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3459:1877914978334592:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.278981:0:21904:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790919781.278988:0:21904:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790919781.279127:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919781.279134:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978334976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919781.279186:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3459:x1877914978334464:12345-0@lo:400:kworker.0 Request processed in 229us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919781.279193:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790919781.279512:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334336 00000100:00100000:3.0:1790919781.279517:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334336 00000100:00100000:3.0:1790919781.279554:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978334080 00000100:00100000:3.0:1790919781.279558:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978334080 00000100:00100000:3.0:1790919781.279577:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978333952 00000100:00100000:3.0:1790919781.279580:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978333952 00000100:00100000:3.0:1790919781.279594:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790919781.279601:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978334336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919781.280566:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978335232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790919781.281500:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3459:x1877914978334976:12345-0@lo:400:kworker.0 Request processed in 2362us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.281513:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790919781.281894:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919781.281906:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.281966:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978334080:12345-0@lo:400:kworker.0 Request processed in 63us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.281973:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790919781.281988:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790919781.281995:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978333952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282025:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978333952:12345-0@lo:400:kworker.0 Request processed in 31us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.282030:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790919781.282288:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac3480 x1877914978334720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919781.282303:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978334720:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282315:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978333824:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282544:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978335104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790919781.282583:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919781.282616:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978333952:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282628:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3459:1877914978334464:0@lo:400:kworker.0 00010000:00080000:1.0:1790919781.282720:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a6ac2300 x1877914978334976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790919781.282729:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3459:1877914978334976:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282738:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1790919781.282746:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978334080:0@lo:400:kworker.0 00000100:00100000:1.0:1790919781.282774:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335104 00000100:00100000:1.0:1790919781.282778:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335104 00000100:00100000:1.0:1790919781.282809:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919781.282815:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978335104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790919781.282841:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919781.282876:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978335104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.282882:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919781.282907:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1790919781.282923:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978335104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790919781.284294:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790919781.284303:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919781.286445:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978334336:12345-0@lo:400:kworker.0 Request processed in 6839us (8446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919781.286461:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790919781.286885:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a6ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978334336:0@lo:400:kworker.0 00000100:00100000:0.0:1790919781.287375:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919781.287445:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335232 00000100:00100000:0.0:1790919781.287453:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335232 00000100:00100000:0.0:1790919781.287502:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919781.287512:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978335232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790919781.287539:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790919781.287602:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978335232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919781.287612:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919781.287893:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978335232:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1790919781.322115:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ac371f0a-d44f-4a58-a70e-41d5105704e6 00000001:00100000:3.0:1790919781.356288:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ac371f0a-d44f-4a58-a70e-41d5105704e6 00010000:00010000:2.0:1790919781.468337:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919781.790798:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919781.790903:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315520 00000100:00100000:2.0:1790919781.790914:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315520 00000100:00100000:2.0:1790919781.791080:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1790919781.791092:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315520:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1790919781.791123:0:21903:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919781.791231:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315520:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919781.791239:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:1.0:1790919781.793348:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790919781.793508:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.793784:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315648 00000100:00100000:1.0:1790919781.793793:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315648 00000100:00100000:1.0:1790919781.793904:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919781.793913:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18398:x1877914958315648:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1790919781.793943:0:24409:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790919781.794021:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18398:x1877914958315648:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 108us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.794028:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:2.0:1790919781.796100:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790919781.800326:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.800537:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315776 00000100:00100000:1.0:1790919781.800548:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315776 00000100:00100000:1.0:1790919781.800684:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919781.800702:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315776:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1790919781.800732:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919781.800819:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315776:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 125us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.800826:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:2.0:1790919781.801302:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919781.802976:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.803218:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958315904 00000100:00100000:1.0:1790919781.803226:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958315904 00000100:00100000:1.0:1790919781.803336:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919781.803346:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315904:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1790919781.803371:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790919781.803456:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18398:x1877914958315904:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.803478:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:2.0:1790919781.803534:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919781.929505:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.929611:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316032 00000100:00100000:1.0:1790919781.929621:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316032 00000100:00100000:1.0:1790919781.929694:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1790919781.929702:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+10:18432:x1877914958316032:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919781.929719:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919781.929736:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1d600/0x951c50ad159154c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f391cd expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.929764:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1d600/0x951c50ad159154c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391cd expref: 11 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.929774:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1d600/0x951c50ad159154c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391cd expref: 11 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.929783:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1d600, rc 0) 00000100:00100000:1.0:1790919781.929839:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316032:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.929846:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:3.0:1790919781.944108:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.944224:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316160 00000100:00100000:1.0:1790919781.944235:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316160 00000100:00100000:1.0:1790919781.944299:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1790919781.944310:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316160:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919781.945088:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316160:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 776us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.945097:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:3.0:1790919781.951269:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919781.951524:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316288 00000100:00100000:2.0:1790919781.951534:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316288 00000100:00100000:2.0:1790919781.951592:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1790919781.951602:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316288:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790919781.951850:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316288:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 249us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919781.951858:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:3.0:1790919781.961549:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.965078:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316416 00000100:00100000:1.0:1790919781.965094:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316416 00000100:00100000:1.0:1790919781.965409:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1790919781.965421:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316416:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919781.965723:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316416:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 303us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.965731:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:3.0:1790919781.981617:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.981835:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316544 00000100:00100000:1.0:1790919781.981845:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316544 00000100:00100000:1.0:1790919781.981996:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:1.0:1790919781.982007:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316544:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919781.982270:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316544:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 264us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.982278:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:3.0:1790919781.988839:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919781.988924:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316672 00000100:00100000:2.0:1790919781.988933:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316672 00000100:00100000:2.0:1790919781.988979:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:2.0:1790919781.988987:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316672:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790919781.989914:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18437:x1877914958316672:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 921us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919781.989924:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:3.0:1790919781.996720:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919781.997928:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316800 00000100:00100000:1.0:1790919781.997940:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316800 00000100:00100000:1.0:1790919781.997990:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1790919781.997999:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18432:x1877914958316800:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790919781.998016:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919781.998032:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f382e1cc00/0x951c50ad159154c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f391fe expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.998365:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f382e1cc00/0x951c50ad159154c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391fe expref: 12 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.998378:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f382e1cc00/0x951c50ad159154c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391fe expref: 12 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919781.998404:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f382e1cc00, rc 0) 00000100:00100000:1.0:1790919781.998481:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18432:x1877914958316800:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 481us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919781.998489:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:3.0:1790919782.002957:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.003535:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958316928 00000100:00100000:2.0:1790919782.003547:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958316928 00000100:00100000:1.0:1790919782.003757:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1790919782.003770:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18432:x1877914958316928:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790919782.003799:0:21897:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790919782.003824:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790919782.003828:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790919782.003831:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790919782.003834:0:21897:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790919782.003836:0:21897:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1790919782.011822:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18432:x1877914958316928:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 8045us (8863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919782.011837:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1790919782.016296:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919782.018236:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317056 00000100:00100000:0.0:1790919782.018250:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317056 00000100:00100000:0.0:1790919782.018320:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:0.0:1790919782.018331:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18432:x1877914958317056:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790919782.018349:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919782.018577:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39205 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.018611:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 13 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.018622:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 13 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.018632:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c0800, rc 0) 00000100:00100000:0.0:1790919782.018707:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18432:x1877914958317056:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 377us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919782.018714:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:3.0:1790919782.022709:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919782.022858:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317184 00000100:00100000:1.0:1790919782.022868:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317184 00000100:00100000:1.0:1790919782.022923:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1790919782.022934:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18432:x1877914958317184:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790919782.023253:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18432:x1877914958317184:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 319us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919782.023262:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:3.0:1790919782.027258:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.027600:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317312 00000100:00100000:2.0:1790919782.027610:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317312 00000100:00100000:2.0:1790919782.027674:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:2.0:1790919782.027684:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18432:x1877914958317312:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790919782.027904:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18432:x1877914958317312:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 221us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.027912:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:2.0:1790919782.031325:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919782.031640:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317440 00000100:00100000:0.0:1790919782.031659:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317440 00000100:00100000:0.0:1790919782.031709:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:0.0:1790919782.031718:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18442:x1877914958317440:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790919782.032032:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18442:x1877914958317440:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 313us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919782.032041:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:3.0:1790919782.036220:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919782.037263:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317568 00000100:00100000:1.0:1790919782.037274:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317568 00000100:00100000:1.0:1790919782.037324:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1790919782.037345:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18442:x1877914958317568:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790919782.037827:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18442:x1877914958317568:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 480us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919782.037836:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:3.0:1790919782.045689:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.045764:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317696 00000100:00100000:2.0:1790919782.045774:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317696 00000100:00100000:3.0:1790919782.045785:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.045982:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317952 00000100:00100000:2.0:1790919782.045986:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317952 00000100:00100000:2.0:1790919782.046091:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790919782.046115:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1877914958317696:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790919782.046154:0:21903:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d@192.168.203.11@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:2.0:1790919782.046191:0:21903:0:(genops.c:1384:class_connect()) connect: client 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d, cookie 0x951c50ad159154d6 00000100:00100000:1.0:1790919782.046209:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1790919782.046217:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2410:x1877914958317952:12345-192.168.203.11@tcp:38:mount.lustre.0 00000004:00100000:2.0:1790919782.046221:0:21903:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1790919782.046237:0:21904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d@192.168.203.11@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:1.0:1790919782.046267:0:21904:0:(genops.c:1384:class_connect()) connect: client 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d, cookie 0x951c50ad159154dd 00000004:00100000:1.0:1790919782.046285:0:21904:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790919782.046555:0:21903:0:(import.c:65:import_set_state_nolock()) ffff95f3bae61000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790919782.046599:0:21904:0:(import.c:65:import_set_state_nolock()) ffff95f391981000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919782.046630:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2410:x1877914958317696:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 514us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919782.046638:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2410:x1877914958317952:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 417us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.046658:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919782.048517:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919782.058634:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.058681:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.058720:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919782.060267:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318208 00000100:00100000:3.0:1790919782.060281:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318208 00000100:00100000:2.0:1790919782.060544:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318080 00000100:00100000:2.0:1790919782.060549:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318080 00000100:00080000:3.0:1790919782.060635:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790919782.060640:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790919782.060732:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958317824 00000100:00100000:2.0:1790919782.060737:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958317824 00000100:00100000:2.0:1790919782.060759:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790919782.060770:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+7:18432:x1877914958318208:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790919782.060822:0:24409:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919782.060912:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+7:18432:x1877914958318208:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 144us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.060921:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790919782.060945:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919782.060967:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:0:x1877914958318080:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790919782.060987:0:24409:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790919782.061018:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:0:x1877914958318080:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 67us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.061038:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919782.061075:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919782.061082:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:0:x1877914958317824:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790919782.061094:0:24409:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919782.061117:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:0:x1877914958317824:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 35us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.061123:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1790919782.065406:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.067415:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318336 00000100:00100000:2.0:1790919782.067430:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318336 00000100:00100000:2.0:1790919782.068390:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919782.068408:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318336:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790919782.068518:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318336:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 116us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.068525:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919782.073938:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.074043:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919782.074122:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919782.074261:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318464 00000100:00100000:0.0:1790919782.074271:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318464 00000100:00100000:0.0:1790919782.074348:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318592 00000100:00100000:0.0:1790919782.074352:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318592 00000100:00100000:1.0:1790919782.074410:0:21915:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318720 00000100:00100000:1.0:1790919782.074414:0:21915:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318720 00000100:00100000:1.0:1790919782.074452:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790919782.074462:0:21915:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318720:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790919782.074547:0:21915:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318720:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 85us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919782.074556:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919782.079766:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919782.079779:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958318464:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790919782.079819:0:24150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d@192.168.203.11@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:2.0:1790919782.079854:0:24150:0:(genops.c:1384:class_connect()) connect: client 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d, cookie 0x951c50ad159154e4 00002000:00100000:2.0:1790919782.079877:0:24150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d/ffff95f3bae62800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919782.079889:0:24150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919782.080005:0:24150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790919782.080040:0:24150:0:(import.c:65:import_set_state_nolock()) ffff95f3bae62000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919782.080310:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2410:x1877914958318464:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 530us (6265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.080327:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919782.080352:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919782.080357:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2410:x1877914958318592:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790919782.080375:0:24150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d@192.168.203.11@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:2.0:1790919782.080396:0:24150:0:(genops.c:1384:class_connect()) connect: client 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d, cookie 0x951c50ad159154eb 00002000:00100000:2.0:1790919782.080402:0:24150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d/ffff95f3bae66000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790919782.080409:0:24150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790919782.080467:0:24150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790919782.080483:0:24150:0:(import.c:65:import_set_state_nolock()) ffff95f3bae66800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790919782.080509:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2410:x1877914958318592:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 151us (6387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919782.080527:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919782.081321:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919782.081444:0:21907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318848 00000100:00100000:3.0:1790919782.081451:0:21907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318848 00000100:00100000:3.0:1790919782.081483:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790919782.081491:0:21907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318848:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790919782.081555:0:21907:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790919782.081611:0:21907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18432:x1877914958318848:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 120us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919782.081617:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1790919782.217170:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919782.217255:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958318976 00000100:00100000:0.0:1790919782.217265:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958318976 00000100:00100000:0.0:1790919782.217330:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919782.217340:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18465:x1877914958318976:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:0.0:1790919782.217374:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919782.217541:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1400/0x951c50ad159154f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39236 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217607:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217627:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217662:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919782.217698:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919782.217701:0:21904:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919782.217720:0:21904:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217743:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1400/0x951c50ad159154f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 8 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217759:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 7 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919782.217768:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:0.0:1790919782.217770:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919782.217773:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c0c00, rc 0) 00000100:00100000:0.0:1790919782.217836:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+7:18465:x1877914958318976:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 497us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919782.217851:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000040:00080000:0.0:1790919782.365867:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790919782.494908:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790919782.894656:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac371f0a-d44f-4a58-a70e-41d5105704e6 00000001:00100000:1.0:1790919782.894679:0:8109:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d 00000001:00100000:3.0:1790919783.359646:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac371f0a-d44f-4a58-a70e-41d5105704e6 00000001:00100000:3.0:1790919783.359684:0:9048:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d 00010000:00010000:0.0:1790919783.516780:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790919784.540143:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919784.755731:0:24500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790919784.860516:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790919784.860539:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978335360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790919784.860605:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919784.860757:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335360 00000100:00100000:1.0:1790919784.860766:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335360 00000100:00100000:1.0:1790919784.860829:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919784.860838:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978335360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790919784.860873:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790919784.860934:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978335360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919784.860941:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790919784.860985:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978335360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919784.861034:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790919785.568215:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919786.396265:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978335872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919786.396341:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.396414:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978336384:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.396480:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978335488:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.396528:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919786.396552:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335872 00000100:00100000:3.0:1790919786.396561:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335872 00000100:00100000:2.0:1790919786.396568:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978336896:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.396603:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919786.396625:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790919786.396636:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978335872:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790919786.396639:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978337408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919786.396677:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1790919786.396679:0:21908:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790919786.396706:0:3461:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790919786.396715:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978335744:0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.396728:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978335872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919786.396736:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919786.396744:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.396764:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978336256:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.396783:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.396791:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.396815:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978336768:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.396828:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978336000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919786.396839:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.396858:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.396874:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978336512:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.396893:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.396907:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978337024:0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.396958:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336896 00000100:00100000:3.0:1790919786.396963:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336896 00000100:00100000:1.0:1790919786.397003:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.397007:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978337280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919786.397031:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790919786.397039:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978335616:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.397091:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.397112:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978336128:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397117:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.397155:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.397160:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978335872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790919786.397185:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978336640:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397193:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336384 00000100:00100000:2.0:1790919786.397198:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336384 00000100:00100000:2.0:1790919786.397260:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335744 00000100:00100000:3.0:1790919786.397262:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336256 00000100:00100000:2.0:1790919786.397265:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335744 00000100:00100000:3.0:1790919786.397267:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336256 00000100:00100000:3.0:1790919786.397285:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336768 00000100:00100000:3.0:1790919786.397288:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336768 00000100:00100000:2.0:1790919786.397292:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336512 00000100:00100000:2.0:1790919786.397297:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336512 00000100:00100000:3.0:1790919786.397307:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337024 00000100:00100000:3.0:1790919786.397312:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337024 00000100:00100000:2.0:1790919786.397318:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336128 00000100:00100000:2.0:1790919786.397321:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336128 00000100:00100000:3.0:1790919786.397336:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919786.397345:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919786.397347:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978336896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397358:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978336384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.397394:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3461:x1877914978336896:12345-0@lo:400:kworker.0 Request processed in 50us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919786.397402:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790919786.397408:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978336384:12345-0@lo:400:kworker.0 Request processed in 52us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.397415:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790919786.397418:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919786.397425:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.397450:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3461:x1877914978336256:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919786.397456:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790919786.397464:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790919786.397477:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978336768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.397499:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3461:x1877914978336768:12345-0@lo:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919786.397505:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790919786.397522:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790919786.397524:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919786.397534:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978335744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.397535:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978337024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919786.397561:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3458:x1877914978337024:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919786.397567:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790919786.397587:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978335744:12345-0@lo:400:kworker.0 Request processed in 56us (843us total) trans 0 rc 0/0 00000100:00080000:3.0:1790919786.397588:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919786.397595:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919786.397599:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790919786.397599:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1790919786.397603:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919786.397632:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790919786.397639:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978336512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397668:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978336512:12345-0@lo:400:kworker.0 Request processed in 30us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.397674:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790919786.397683:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.397688:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919786.397695:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978336128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.397720:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978337152:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.397761:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919786.397782:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978336512:0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.397792:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3458:1877914978337024:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397810:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978336128:12345-0@lo:400:kworker.0 Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919786.397813:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978336128:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.397823:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790919786.397846:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335616 00000100:00100000:2.0:1790919786.397851:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335616 00000100:00100000:1.0:1790919786.397860:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337408 00000100:00100000:1.0:1790919786.397865:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337408 00000100:00100000:2.0:1790919786.397884:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337280 00000100:00100000:2.0:1790919786.397890:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337280 00000100:00100000:1.0:1790919786.397891:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336000 00000100:00100000:1.0:1790919786.397896:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336000 00000100:00100000:2.0:1790919786.397910:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919786.397919:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919786.397920:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.397931:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978337408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790919786.397953:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919786.397969:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3458:x1877914978335616:12345-0@lo:400:kworker.0 Request processed in 51us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.397977:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790919786.397992:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978337408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.397995:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919786.398004:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790919786.398008:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978337280:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790919786.398024:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790919786.398032:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978336000:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1790919786.398044:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00002000:00000024:1.0:1790919786.398081:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790919786.398097:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3461:x1877914978337280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.398113:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790919786.398118:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978336000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919786.398126:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919786.398134:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978336640 00000100:00100000:2.0:1790919786.398139:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978336640 00000100:00100000:2.0:1790919786.398155:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337152 00000100:00100000:2.0:1790919786.398158:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337152 00000100:00100000:1.0:1790919786.398169:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790919786.398179:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978336640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398186:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919786.398196:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790919786.398210:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3458:x1877914978336640:12345-0@lo:400:kworker.0 Request processed in 34us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919786.398217:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790919786.398240:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3458:x1877914978337152:12345-0@lo:400:kworker.0 Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.398248:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790919786.398282:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978335488 00000100:00100000:2.0:1790919786.398285:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978335488 00000100:00100000:2.0:1790919786.398316:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790919786.398322:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3458:x1877914978335488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398367:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3458:x1877914978335488:12345-0@lo:400:kworker.0 Request processed in 44us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.398374:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1790919786.398402:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790919786.398433:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978335616:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398444:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3458:1877914978336640:0@lo:400:kworker.0 00010000:00080000:2.0:1790919786.398454:0:3458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebd180 x1877914978337152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919786.398465:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3458:1877914978337152:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398473:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978335488:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398502:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978336000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790919786.398551:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978335744:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398566:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3461:1877914978336256:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398581:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3461:1877914978336768:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398597:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3461:1877914978337280:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1790919786.398610:0:3461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f383ebf480 x1877914978336896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790919786.398632:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3461:1877914978336896:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.398652:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978337408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790919786.398666:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978336384:0@lo:400:kworker.0 00000100:00100000:2.0:1790919786.399259:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978337536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790919786.399299:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919786.399343:0:23213:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337536 00000100:00100000:2.0:1790919786.399348:0:23213:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337536 00000100:00100000:2.0:1790919786.399379:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919786.399387:0:23213:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978337536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790919786.399402:0:23213:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790919786.400580:0:23213:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978337536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1190us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919786.400590:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790919786.406972:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f284c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978337536:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790919786.474951:0:6467:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d 00000001:00100000:0.0:1790919786.478566:0:7248:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d 00010000:00010000:0.0:1790919786.592780:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919787.465272:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919787.465373:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919787.465408:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919787.465427:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919787.465451:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919787.465480:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319616 00000100:00100000:1.0:1790919787.465490:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319616 00000100:00100000:1.0:1790919787.465543:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320128 00000100:00100000:1.0:1790919787.465547:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320128 00000100:00100000:1.0:1790919787.465568:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919787.465578:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958319616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919787.465659:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958319616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919787.465667:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1790919787.465683:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919787.465690:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958320128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919787.465714:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958320128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919787.465721:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1790919787.465894:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319360 00000100:00100000:2.0:1790919787.465899:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319360 00000100:00100000:2.0:1790919787.465947:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319872 00000100:00100000:2.0:1790919787.465950:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319872 00000100:00100000:2.0:1790919787.465975:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919787.465982:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958319360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919787.466018:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958319360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919787.466024:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919787.466041:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1790919787.466048:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958319872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919787.466089:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a6ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958319872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919787.466095:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00080000:2.0:1790919787.466119:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790919787.466123:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790919787.467842:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319104 00000100:00100000:0.0:1790919787.467855:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319104 00000100:00100000:0.0:1790919787.467906:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1790919787.467926:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2414:x1877914958319104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919787.467997:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2414:x1877914958319104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (3953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.468006:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1790919787.468934:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919787.469092:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919787.469122:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919787.469149:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919787.469199:0:23210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319488 00000100:00100000:0.0:1790919787.469212:0:23210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319488 00000100:00100000:0.0:1790919787.469268:0:23210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320000 00000100:00100000:0.0:1790919787.469271:0:23210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320000 00000100:00100000:2.0:1790919787.469282:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1790919787.469295:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958319488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919787.469316:0:23210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1790919787.469352:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958319488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 60us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919787.469360:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919787.469765:0:23210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b4317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958320000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919787.469806:0:23210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b4317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958320000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 482us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.469814:0:23210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1790919787.469838:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319232 00000100:00100000:0.0:1790919787.469842:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319232 00000100:00100000:0.0:1790919787.469871:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958319744 00000100:00100000:0.0:1790919787.469874:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958319744 00000100:00100000:0.0:1790919787.469897:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919787.469904:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2413:x1877914958319232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919787.469935:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2413:x1877914958319232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.469941:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919787.469953:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790919787.469959:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2413:x1877914958319744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1790919787.469985:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f284c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2413:x1877914958319744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.469990:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00080000:0.0:1790919787.470005:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919787.470009:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790919787.613200:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790919787.769733:0:24649:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd949fa70 20000000:00000080:2.0:1790919787.769751:0:24649:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95f3a9a2e800 uarg=0000000000000000 20000000:01000000:2.0:1790919787.769786:0:24649:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919787.769792:0:24649:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790919787.769801:0:24649:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790919787.770912:0:24650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790919787.771240:0:24649:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790919787.785068:0:24649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790919787.785096:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785115:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915156 expref: 23 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785123:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915164 expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785129:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159151a3 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785146:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785157:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 12 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785165:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 12 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785172:0:24649:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785213:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 12 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785228:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 12 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.785255:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337664:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919787.785356:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 12 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785364:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 12 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.785372:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337792:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919787.785398:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785407:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.785414:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337920:0@lo:104: 00000100:00100000:2.0:1790919787.785449:0:24649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919787.785485:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 23 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785492:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 23 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.785501:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338048:0@lo:104: 00000100:00100000:2.0:1790919787.785520:0:24649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790919787.785540:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.785548:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 23 pid: 21898 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919787.785635:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978337920 00000100:00100000:1.0:1790919787.785643:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978337920 00000100:00100000:1.0:1790919787.785687:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338048 00000100:00100000:1.0:1790919787.785690:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338048 00000100:00100000:1.0:1790919787.785703:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919787.785712:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:24649:x1877914978337920:12345-0@lo:104: 00010000:00010000:1.0:1790919787.785732:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.785777:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790919787.785783:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+4:24649:x1877914978337920:12345-0@lo:104: Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919787.785790:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790919787.785807:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919787.785813:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338048:12345-0@lo:104: 00010000:00010000:1.0:1790919787.785821:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.785850:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790919787.785855:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338048:12345-0@lo:104: Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919787.785861:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790919787.787779:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790919787.787789:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787798:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2c600 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919787.787811:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787821:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919787.787828:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919787.787834:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919787.787894:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787901:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919787.787926:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787933:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2c600/0x951c50ad15915316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591531d expref: -99 pid: 23931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787953:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790919787.787957:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787962:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3bce2ca00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:0.0:1790919787.787965:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.787971:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790919787.787988:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919787.787993:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790919787.788021:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.788027:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790919787.788042:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.788049:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3bce2ca00/0x951c50ad159151a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad159151aa expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.788080:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919787.788082:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919787.788084:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790919787.788090:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790919787.788116:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978338304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919787.788171:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919787.788230:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978338432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790919787.788253:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919787.788301:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338304 00000100:00100000:0.0:1790919787.788307:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338304 00010000:00010000:0.0:1790919787.788332:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 24 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919787.788363:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338432 00000100:00100000:0.0:1790919787.788373:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338432 00010000:00010000:0.0:1790919787.788388:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 25 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919787.788403:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919787.788412:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3459:x1877914978338304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919787.788424:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919787.788428:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 25 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919787.789732:0:21889:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790919787.789744:0:21889:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790919787.789760:0:21891:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790919787.789772:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790919787.789782:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3460:x1877914978338432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919787.789797:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919787.789803:0:21891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 25 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.791116:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338176:0@lo:104: 00000100:00100000:3.0:1790919787.791255:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919787.791279:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919787.791323:0:24649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919787.791402:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338176 00000100:00100000:2.0:1790919787.791409:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338176 00000100:00100000:2.0:1790919787.791453:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790919787.791461:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338176:12345-0@lo:104: 00010000:00010000:2.0:1790919787.791476:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791522:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790919787.791528:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338176:12345-0@lo:104: Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919787.791535:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790919787.791555:0:21893:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919787.791561:0:21893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791567:0:21893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3ac6a8e00 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919787.791571:0:21893:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791580:0:21893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919787.791587:0:21893:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919787.791592:0:21893:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919787.791636:0:21893:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791656:0:21893:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919787.791678:0:21893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791686:0:21893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3ac6a8e00/0x951c50ad15915164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591516b expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.791698:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919787.791700:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919787.791701:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919787.791715:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978338560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919787.791745:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790919787.791833:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 25 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.791854:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919787.791897:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3459:x1877914978338304:12345-0@lo:103:ldlm_bl.0 Request processed in 3486us (3726us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.791906:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790919787.791924:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.791930:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320256 00000100:00100000:0.0:1790919787.791933:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320256 00010000:00010000:0.0:1790919787.791947:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 13 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919787.791957:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.791960:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320384 00000100:00100000:0.0:1790919787.791962:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320384 00010000:00010000:0.0:1790919787.791970:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 14 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919787.791978:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.791981:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338560 00000100:00100000:0.0:1790919787.791989:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338560 00010000:00010000:0.0:1790919787.792000:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 25 pid: 21898 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919787.792024:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.792031:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919787.792037:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+14:2413:x1877914958320256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919787.792047:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919787.792070:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 14 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792080:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 14 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792091:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919787.792134:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+14:2413:x1877914958320256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 95us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.792140:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1790919787.792152:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.792158:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919787.792163:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2413:x1877914958320384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919787.792185:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919787.792190:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 13 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792199:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 13 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792209:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919787.792234:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2413:x1877914958320384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 70us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.792240:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1790919787.792251:0:21890:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790919787.792256:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790919787.792262:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3461:x1877914978338560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790919787.792277:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919787.792283:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 25 pid: 21898 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792291:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 25 pid: 21898 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919787.792300:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919787.792327:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+25:3461:x1877914978338560:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919787.792333:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1790919787.792974:0:21891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 24 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.792999:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919787.793094:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3460:x1877914978338432:12345-0@lo:103:ldlm_bl.0 Request processed in 3314us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919787.793102:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790919787.795645:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978338432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919787.795772:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3461:1877914978338560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919787.795799:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3459:1877914978338304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790919787.796738:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 23 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919787.796759:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 23 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.796774:0:24649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338688:0@lo:104: 00000100:00100000:3.0:1790919787.796838:0:24649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919787.796916:0:24649:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3906e8840 going to sleep for 11 seconds 00010000:00010000:3.0:1790919787.796936:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3a68c0800/0x951c50ad159154cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39205 expref: 12 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.796965:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337664:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919787.796980:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39195 expref: 11 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.796988:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337792:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919787.796999:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f382e1d200/0x951c50ad1591531d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15915316 expref: 23 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.797018:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978337920:0@lo:104: 00010000:00010000:3.0:1790919787.797030:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a1200/0x951c50ad159151aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad159151a3 expref: 22 pid: 21897 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.797039:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338048:0@lo:104: 00010000:00010000:3.0:1790919787.797048:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3bce2da00/0x951c50ad1591516b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15915164 expref: 21 pid: 21898 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919787.797086:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338176:0@lo:104: 00000100:00100000:2.0:1790919787.797385:0:21888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338688 00000100:00100000:2.0:1790919787.797392:0:21888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338688 00000100:00100000:3.0:1790919787.797492:0:21888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790919787.797500:0:21888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338688:12345-0@lo:104: 00010000:00010000:3.0:1790919787.797514:0:21888:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919787.797661:0:21888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790919787.797668:0:21888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+3:24649:x1877914978338688:12345-0@lo:104: Request processed in 169us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919787.797675:0:21888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790919787.797733:0:21892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919787.797740:0:21892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.797748:0:21892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0200 already unused, calling callback (ffffffffc1a99c20) 10000000:00010000:2.0:1790919787.797752:0:21892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.797761:0:21892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790919787.797780:0:21892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919787.797786:0:21892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790919787.797823:0:21892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.797830:0:21892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790919787.797849:0:21892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.797856:0:21892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff95f3857a0200/0x951c50ad15915156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x951c50ad1591515d expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.797872:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919787.797874:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919787.797876:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790919787.797888:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978338816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790919787.797921:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919787.797970:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338816 00000100:00100000:2.0:1790919787.797975:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338816 00010000:00010000:2.0:1790919787.797993:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 21 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919787.798028:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919787.798036:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978338816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790919787.798046:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919787.798077:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 21 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798095:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 21 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798111:0:21890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798119:0:21890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798132:0:21890:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798139:0:21890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798145:0:21890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798151:0:21890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798157:0:21890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919787.798161:0:21890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798169:0:21890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798176:0:21890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919787.798196:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919787.798225:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:3458:x1877914978338816:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919787.798232:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790919787.798261:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3458:1877914978338816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790919787.798876:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a0e00/0x951c50ad1591515d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x951c50ad15915156 expref: 20 pid: 21896 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919787.798887:0:24649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f2863be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24649:1877914978338688:0@lo:104: 00010000:00010000:1.0:1790919787.798914:0:24649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.798923:0:24649:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.798929:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919787.798935:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95f3857a0c00/0x951c50ad15915500 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919788.636855:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919788.872622:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919788.872734:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320512 00000100:00100000:2.0:1790919788.872743:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320512 00000100:00100000:2.0:1790919788.872800:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:2.0:1790919788.872810:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+11:18312:x1877914958320512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919788.872828:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919788.872848:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a1600/0x951c50ad15915507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3923d expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919788.872876:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a1600/0x951c50ad15915507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3923d expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919788.872889:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a1600/0x951c50ad15915507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3923d expref: 12 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919788.872899:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a1600, rc 0) 00000100:00100000:2.0:1790919788.872968:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38dd76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320512:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919788.872975:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:0.0:1790919788.878016:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919788.878185:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320640 00000100:00100000:1.0:1790919788.878196:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320640 00000100:00100000:1.0:1790919788.878250:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:1.0:1790919788.878261:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919788.878554:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320640:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 294us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919788.878563:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:3.0:1790919788.880264:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919788.880361:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320768 00000100:00100000:2.0:1790919788.880370:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320768 00000100:00100000:2.0:1790919788.880464:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:2.0:1790919788.880485:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919788.880719:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320768:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919788.880727:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1790919788.888173:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919788.889714:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958320896 00000100:00100000:1.0:1790919788.889728:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958320896 00000100:00100000:1.0:1790919788.889797:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:1.0:1790919788.889807:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+12:18312:x1877914958320896:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919788.889824:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919788.889842:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166cc00/0x951c50ad1591550e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39244 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919788.889872:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166cc00/0x951c50ad1591550e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39244 expref: 13 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919788.889883:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166cc00/0x951c50ad1591550e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39244 expref: 13 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919788.889892:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166cc00, rc 0) 00000100:00100000:1.0:1790919788.890154:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18312:x1877914958320896:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 348us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919788.890162:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:1.0:1790919788.907031:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919788.907245:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321024 00000100:00100000:2.0:1790919788.907255:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321024 00000100:00100000:2.0:1790919788.907306:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:2.0:1790919788.907315:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18312:x1877914958321024:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919788.907594:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18312:x1877914958321024:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 279us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919788.907610:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:0.0:1790919788.914976:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919788.916014:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321152 00000100:00100000:1.0:1790919788.916030:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321152 00000100:00100000:1.0:1790919788.916127:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:1.0:1790919788.916146:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18312:x1877914958321152:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919788.916373:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:18312:x1877914958321152:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 237us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919788.916382:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:3.0:1790919789.417835:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919789.422838:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321280 00000100:00100000:0.0:1790919789.422987:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321280 00000100:00100000:0.0:1790919789.423519:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1790919789.423533:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:18934:x1877914958321280:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919789.423554:0:21903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919789.423575:0:21903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1800/0x951c50ad15915515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3924b expref: -99 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424275:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424289:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424301:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424316:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424323:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.424330:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428764:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1000/0x951c50ad1591552a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428790:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1000/0x951c50ad1591552a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428803:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1000/0x951c50ad1591552a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919789.428849:0:21903:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790919789.428853:0:21903:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1790919789.428891:0:21903:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1000/0x951c50ad1591552a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428923:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428930:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428936:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428943:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919789.428947:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428955:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428967:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:0.0:1790919789.428970:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919789.428974:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428979:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591551c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.428993:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429000:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429006:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429016:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c1200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919789.429020:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429026:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429035:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff95f385107900) 00010000:00010000:0.0:1790919789.429037:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919789.429040:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429046:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429140:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1800/0x951c50ad15915515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3924b expref: 8 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429155:0:21903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1000/0x951c50ad1591552a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3924b expref: 7 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.429162:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f385107800) 00010000:00010000:0.0:1790919789.429164:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790919789.429166:0:21903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1000, rc 0) 00000100:00100000:0.0:1790919789.429233:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18934:x1877914958321280:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 5704us (11407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.429242:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1790919789.435454:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.435570:0:21914:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321408 00000100:00100000:1.0:1790919789.435588:0:21914:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321408 00000100:00100000:1.0:1790919789.435669:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919789.435680:0:21914:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18934:x1877914958321408:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790919789.435772:0:21914:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18934:x1877914958321408:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 95us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.435780:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00080000:2.0:1790919789.436488:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919789.455188:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919789.455304:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321664 00000100:00100000:0.0:1790919789.455315:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321664 00000100:00100000:0.0:1790919789.455380:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1790919789.455390:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:18934:x1877914958321664:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919789.455413:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919789.455433:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1800/0x951c50ad15915531 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39252 expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455517:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455532:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455542:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455555:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455562:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455568:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455931:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0000/0x951c50ad15915546 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455941:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0000/0x951c50ad15915546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.455961:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0000/0x951c50ad15915546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790919789.455972:0:21905:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1790919789.456247:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456256:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456263:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456269:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c1200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919789.456274:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456282:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456294:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff95f385107800) 00010000:00010000:0.0:1790919789.456297:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919789.456303:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456309:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1200/0x951c50ad15915538 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456320:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456326:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456339:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456345:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919789.456349:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456356:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456365:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff95f385107900) 00010000:00010000:0.0:1790919789.456367:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919789.456371:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456378:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0800/0x951c50ad1591553f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456850:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c1800/0x951c50ad15915531 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39252 expref: 10 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456867:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0000/0x951c50ad15915546 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39252 expref: 9 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.456875:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f385107300) 00010000:00010000:0.0:1790919789.456877:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919789.456880:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c0000, rc 0) 00000100:00100000:0.0:1790919789.456946:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18934:x1877914958321664:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1557us (1768us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790919789.456962:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1790919789.464282:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.464541:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321792 00000100:00100000:1.0:1790919789.464551:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321792 00000100:00100000:1.0:1790919789.464618:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790919789.464629:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18934:x1877914958321792:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790919789.464757:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18934:x1877914958321792:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 130us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.464765:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790919789.473749:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919789.473897:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958321920 00000100:00100000:0.0:1790919789.473907:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958321920 00000100:00100000:0.0:1790919789.473987:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1790919789.474008:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18934:x1877914958321920:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1790919789.474239:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1790919789.475738:0:21905:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1686us 00000100:00100000:1.0:1790919789.514038:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f285ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18934:x1877914958321920:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 40031us (40287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.514084:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790919789.514998:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919789.515102:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322048 00000100:00100000:3.0:1790919789.515112:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322048 00000100:00100000:3.0:1790919789.515661:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919789.515674:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18940:x1877914958322048:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919789.515701:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919789.515726:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfe00/0x951c50ad15915554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39259 expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515794:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515810:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515824:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515865:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515874:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.515880:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516162:0:24409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516170:0:24409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516176:0:24409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516181:0:24409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919789.516185:0:24409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516192:0:24409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516204:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:3.0:1790919789.516206:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919789.516211:0:24409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516216:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf800/0x951c50ad1591555b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516227:0:24409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516232:0:24409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516237:0:24409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516249:0:24409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919789.516252:0:24409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516258:0:24409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516265:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3930c1c00) 00010000:00010000:3.0:1790919789.516268:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919789.516270:0:24409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516276:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad15915562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516309:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfe00/0x951c50ad15915554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39259 expref: 10 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516317:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:3.0:1790919789.516319:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919789.516323:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfe00/0x951c50ad15915554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39259 expref: 10 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.516331:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfdfe00, rc 0) 00000100:00100000:3.0:1790919789.516392:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18940:x1877914958322048:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 722us (1404us total) trans 0 rc 301/301 00000100:00100000:3.0:1790919789.516400:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1790919789.527178:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919789.527386:0:21912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322176 00000100:00100000:0.0:1790919789.527396:0:21912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322176 00000100:00100000:0.0:1790919789.527456:0:21912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790919789.527466:0:21912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18940:x1877914958322176:12345-192.168.203.11@tcp:700:lfs.0 00000100:00100000:0.0:1790919789.527563:0:21912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2863bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18940:x1877914958322176:12345-192.168.203.11@tcp:700:lfs.0 Request processed in 98us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.527571:0:21912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 10000000:01000000:3.0:1790919789.533149:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919789.533157:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f38716e000 from 13 10000000:01000000:3.0:1790919789.533163:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919789.533239:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.533252:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.533264:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.533293:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978338944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.533372:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919789.533421:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790919789.533500:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978338944 00000100:00100000:0.0:1790919789.533508:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978338944 00000100:00100000:0.0:1790919789.533550:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790919789.533558:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+20:21900:x1877914978338944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919789.533572:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919789.533584:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915570 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad15915569 expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.533617:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad15915569 expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.533627:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1800/0x951c50ad15915570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad15915569 expref: 21 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.533650:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1800, rc 0) 00000100:00100000:0.0:1790919789.533699:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978338944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.533706:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790919789.533833:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978338944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790919789.533848:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915570 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.533856:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915570 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.533906:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.533934:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919789.533963:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919789.533965:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339072 00000100:00100000:1.0:1790919789.533972:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339072 00000100:00100000:1.0:1790919789.534010:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790919789.534019:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978339072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919789.534289:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978339072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.534297:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790919789.534330:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790919789.534370:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919789.534602:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790919789.534631:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f385384c00 going to sleep for 11 seconds 00000040:00080000:2.0:1790919789.534680:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790919789.534752:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339200 00000100:00100000:0.0:1790919789.534758:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339200 00000100:00100000:0.0:1790919789.534789:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790919789.534797:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978339200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.534962:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978339200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.534970:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790919789.536556:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.536575:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.536669:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322432 00000100:00100000:3.0:1790919789.536677:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322432 00000100:00100000:3.0:1790919789.536730:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1790919789.536740:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:18940:x1877914958322432:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1790919789.536804:0:21904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919789.536828:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f382e1c200/0x951c50ad159154ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f391c6 expref: 9 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.536846:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:3.0:1790919789.536850:0:21904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919789.537583:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.537701:0:21904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 5 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.537712:0:21904:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.537749:0:21904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 5 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.537766:0:21904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 5 pid: 21904 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.537780:0:21904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21904:1877914978339328:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919789.537859:0:21904:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35e40 going to sleep for 11 seconds 00000040:00080000:1.0:1790919789.541643:0:24665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790919789.542020:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790919789.542045:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790919789.542336:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915570 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.542349:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38dfdfe00/0x951c50ad15915569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915570 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790919789.542362:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790919789.542365:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4511000 from 13 10000000:01000000:2.0:1790919789.542368:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790919789.542409:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.542436:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.542449:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919789.542473:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.542546:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919789.542648:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3a6815480 going to sleep for 11 seconds 00000100:00100000:2.0:1790919789.545488:0:21904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21904:1877914978339328:192.168.203.11@tcp:104: 00010000:00010000:2.0:1790919789.545518:0:21904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919789.546782:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.547019:0:24651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322560 00000100:00100000:1.0:1790919789.547029:0:24651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322560 00010000:00010000:1.0:1790919789.547111:0:24651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 6 pid: 21904 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919789.547163:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:2.0:1790919789.547165:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919789.547175:0:24651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2413:x1877914958322560:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919789.547192:0:24651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919789.547200:0:24651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 6 pid: 21904 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547215:0:24651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 6 pid: 21904 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547238:0:24651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad159154f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39236 expref: 6 pid: 21904 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547252:0:24651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:1.0:1790919789.547257:0:24651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547266:0:24651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547287:0:24651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.547323:0:24651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919789.547512:0:21904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.547522:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.547548:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919789.547557:0:24651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958322560:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 382us (781us total) trans 0 rc 0/0 00010000:00010000:2.0:1790919789.547559:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919789.547574:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:2.0:1790919789.547575:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.548944:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.548962:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.548972:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919789.548988:0:21904:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b288c34c reply state 000000006ceca576 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.548998:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549006:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919789.549009:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919789.549013:0:21904:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790919789.549018:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919789.549027:0:21904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549033:0:21904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549040:0:21904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549045:0:21904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdfc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919789.549072:0:21904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549092:0:21904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549103:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142d00) 00010000:00010000:2.0:1790919789.549106:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919789.549110:0:21904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549116:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdfc00/0x951c50ad15915577 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919789.549133:0:21904:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b288c34c reply state 000000006ceca576 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549142:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.549147:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3904a5c00) 00010000:00010000:2.0:1790919789.549149:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919789.549152:0:21904:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790919789.549230:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:18940:x1877914958322432:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 12488us (12679us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1790919789.549239:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1790919789.550025:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339456 00000100:00100000:0.0:1790919789.550036:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339456 00000100:00100000:0.0:1790919789.550110:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790919789.550119:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+21:21900:x1877914978339456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919789.550146:0:21896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919789.550160:0:21896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3a68c1200/0x951c50ad15915593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591557e expref: -99 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.550183:0:21896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3a68c1200/0x951c50ad15915593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591557e expref: 22 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.550194:0:21896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3a68c1200/0x951c50ad15915593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591557e expref: 22 pid: 21896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.550201:0:21896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1200, rc 0) 00000100:00100000:0.0:1790919789.550404:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 285us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.550411:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790919789.550576:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919789.550706:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915593 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.550717:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad15915593 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919789.550805:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.550840:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919789.550876:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790919789.550976:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339584 00000100:00100000:0.0:1790919789.550981:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339584 00000100:00100000:0.0:1790919789.551262:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790919789.551275:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.551518:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.552713:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.552778:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.552838:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919789.552873:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919789.553151:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339712 00000100:00100000:3.0:1790919789.553158:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339712 00000100:00100000:0.0:1790919789.554408:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790919789.561139:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790919789.561170:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.561449:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (8608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919789.561464:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790919789.561652:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790919789.563990:0:24666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790919789.564753:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790919789.564781:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790919789.564792:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915593 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.564804:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3857a0a00/0x951c50ad1591557e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad15915593 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790919789.564813:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790919789.564816:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f286c1f000 from 13 10000000:01000000:0.0:1790919789.564818:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790919789.564857:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.564865:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.564877:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919789.564931:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.565001:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.565046:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919789.565099:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339840 00000100:00100000:2.0:1790919789.565108:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339840 00000100:00100000:2.0:1790919789.565151:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790919789.565160:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+22:21900:x1877914978339840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790919789.565175:0:21898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919789.565267:0:21898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f3857a0e00/0x951c50ad159155a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad1591559a expref: -99 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.565291:0:21898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f3857a0e00/0x951c50ad159155a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad1591559a expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.565302:0:21898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f3857a0e00/0x951c50ad159155a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad1591559a expref: 23 pid: 21898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.565311:0:21898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0e00, rc 0) 00000100:00100000:2.0:1790919789.565360:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978339840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.565375:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790919789.565410:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919789.565424:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155a1 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.565434:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159155a1 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919789.565480:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.565507:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.565535:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790919789.565602:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978339968 00000100:00100000:3.0:1790919789.565608:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978339968 00000100:00100000:3.0:1790919789.565648:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790919789.565656:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978339968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.565919:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978339968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919789.565926:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790919789.566295:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978339968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.566330:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.566375:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.566400:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398cedb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790919789.566800:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978340096 00000100:00100000:2.0:1790919789.566807:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978340096 00000100:00100000:2.0:1790919789.566846:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790919789.566854:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978340096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.567021:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978340096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.567028:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790919789.567044:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919789.571425:0:24667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790919789.575110:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790919789.575160:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790919789.575173:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155a1 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.575186:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f3a68c0200/0x951c50ad1591559a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155a1 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790919789.575199:0:21900:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790919789.575201:0:21900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95f3b4169000 from 13 10000000:01000000:3.0:1790919789.575203:0:21900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790919789.575247:0:21900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.575256:0:21900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.575268:0:21900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.575296:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790919789.575390:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919789.575427:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3aeb35c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790919789.575785:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978340224 00000100:00100000:1.0:1790919789.575794:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978340224 00000100:00100000:1.0:1790919789.575835:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790919789.575843:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+23:21900:x1877914978340224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790919789.575857:0:21897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.575872:0:21897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95f38166c600/0x951c50ad159155af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x951c50ad159155a8 expref: -99 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.575913:0:21897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95f38166c600/0x951c50ad159155af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x951c50ad159155a8 expref: 24 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.575922:0:21897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95f38166c600/0x951c50ad159155af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x951c50ad159155a8 expref: 24 pid: 21897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.575931:0:21897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c600, rc 0) 00000100:00100000:1.0:1790919789.575988:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978340224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.575994:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790919789.576214:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790919789.576231:0:21900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155af expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919789.576240:0:21900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x951c50ad159155af expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919789.576308:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.576340:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.576371:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced240 going to sleep for 11 seconds 00000100:00100000:2.0:1790919789.576379:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978340352 00000100:00100000:2.0:1790919789.576384:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978340352 00000100:00100000:2.0:1790919789.576408:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790919789.576415:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978340352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790919789.576689:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978340352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.576697:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790919789.577040:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.577126:0:21900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790919789.577169:0:21900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.577191:0:21900:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919789.577214:0:21897:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978340480 00000100:00100000:1.0:1790919789.577219:0:21897:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978340480 00000100:00100000:1.0:1790919789.577245:0:21897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790919789.577259:0:21897:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978340480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790919789.577418:0:21897:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:21900:x1877914978340480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.577425:0:21897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790919789.578016:0:21900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a9a25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:21900:1877914978340480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790919789.580735:0:24668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790919789.580881:0:21900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790919789.580909:0:21900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790919789.580920:0:21900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155af expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.580932:0:21900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff95f38dfdf800/0x951c50ad159155a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x951c50ad159155af expref: -99 pid: 21900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.626363:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.626467:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322688 00000100:00100000:1.0:1790919789.626478:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322688 00000100:00100000:1.0:1790919789.626544:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1790919789.626554:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:18948:x1877914958322688:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:1.0:1790919789.626580:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.626614:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159155b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39260 expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626688:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad159155bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626702:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad159155bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626713:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad159155bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.626767:0:24409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919789.626771:0:24409:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919789.626809:0:24409:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad159155bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626833:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159155b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39260 expref: 12 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626864:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ce00/0x951c50ad159155bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39260 expref: 11 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.626873:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:1.0:1790919789.626876:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919789.626879:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ce00, rc 0) 00000100:00100000:1.0:1790919789.626943:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+11:18948:x1877914958322688:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 391us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.626951:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00010000:00010000:2.0:1790919789.660262:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919789.663481:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.663629:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322816 00000100:00100000:1.0:1790919789.663699:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322816 00000100:00100000:1.0:1790919789.663841:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1790919789.663852:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:18949:x1877914958322816:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919789.663875:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.663897:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159155c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39267 expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.663965:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159155cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.664235:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159155cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.664248:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159155cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.664284:0:21905:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919789.664288:0:21905:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919789.664311:0:21905:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159155cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.664337:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159155c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39267 expref: 7 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.664371:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d200/0x951c50ad159155cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39267 expref: 6 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.664381:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:1.0:1790919789.664384:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919789.664387:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d200, rc 0) 00000100:00100000:1.0:1790919789.664445:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18949:x1877914958322816:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 594us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.664452:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1790919789.667907:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.667979:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958322944 00000100:00100000:1.0:1790919789.667988:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958322944 00000100:00100000:1.0:1790919789.668370:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1790919789.668380:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:18949:x1877914958322944:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919789.668401:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.668432:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159155d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3926e expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668495:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668508:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668518:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668528:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668535:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.668541:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669176:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669188:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669196:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.669226:0:24409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919789.669229:0:24409:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919789.669247:0:24409:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669266:0:24409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669272:0:24409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669279:0:24409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669284:0:24409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919789.669287:0:24409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669294:0:24409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669305:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:1.0:1790919789.669307:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919789.669311:0:24409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669317:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad159155d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669343:0:24409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669350:0:24409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669355:0:24409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669367:0:24409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919789.669371:0:24409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669376:0:24409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669384:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3904a5c00) 00010000:00010000:1.0:1790919789.669386:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919789.669389:0:24409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669395:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad159155e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669424:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159155d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3926e expref: 8 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669438:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3926e expref: 7 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.669445:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919789.669447:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919789.669450:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166da00, rc 0) 00000100:00100000:1.0:1790919789.669518:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+7:18949:x1877914958322944:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1139us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.669526:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1790919789.672796:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.672927:0:21914:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958323072 00000100:00100000:1.0:1790919789.672951:0:21914:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958323072 00000100:00100000:1.0:1790919789.673041:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919789.673079:0:21914:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:18949:x1877914958323072:12345-192.168.203.11@tcp:900:lfs.0 00000100:00100000:1.0:1790919789.673189:0:21914:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:18949:x1877914958323072:12345-192.168.203.11@tcp:900:lfs.0 Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.673197:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00080000:2.0:1790919789.673614:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919789.678773:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919789.678898:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958323328 00000100:00100000:2.0:1790919789.678907:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958323328 00000100:00100000:2.0:1790919789.678970:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1790919789.678980:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+7:18949:x1877914958323328:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1790919789.679012:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919789.679036:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad159155ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39275 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919789.679347:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790919789.679478:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad159155ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39275 expref: 9 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.679492:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:2.0:1790919789.679495:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790919789.679500:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad159155ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39275 expref: 9 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.679517:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3857a0400, rc 0) 00000100:00100000:2.0:1790919789.679585:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+8:18949:x1877914958323328:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 606us (822us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1790919789.679601:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1790919789.688087:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919789.688225:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958323584 00000100:00100000:3.0:1790919789.688236:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958323584 00000100:00100000:3.0:1790919789.688286:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919789.688296:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+8:18949:x1877914958323584:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1790919789.688494:0:21903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790919789.688521:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166da00/0x951c50ad159155e7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3926e expref: 8 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.688555:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919789.688560:0:21903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790919789.688583:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.688610:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.688620:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790919789.689660:0:21903:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fdb4c6aa reply state 00000000ad15d5a3 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.689680:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.689701:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919789.689704:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790919789.689707:0:21903:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790919789.689718:0:21903:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790919789.689823:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+9:18949:x1877914958323584:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1525us (1743us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790919789.689831:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1790919789.692495:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.692620:0:21907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958323840 00000100:00100000:1.0:1790919789.692631:0:21907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958323840 00000100:00100000:1.0:1790919789.692718:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790919789.692728:0:21907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+9:18949:x1877914958323840:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919789.693027:0:21907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+10:18949:x1877914958323840:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 300us (540us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1790919789.693035:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919789.696335:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.696417:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324096 00000100:00100000:1.0:1790919789.696427:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324096 00000100:00100000:1.0:1790919789.696491:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1790919789.696500:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+10:18949:x1877914958324096:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919789.696525:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.696545:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3927c expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696629:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696653:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696664:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696690:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696699:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696706:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.696831:0:21905:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790919789.696925:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696933:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696939:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696945:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919789.696950:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696957:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.696969:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:1.0:1790919789.696972:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919789.696976:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697505:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591560a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697519:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697525:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697531:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697537:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919789.697540:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697547:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697557:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3904a5c00) 00010000:00010000:1.0:1790919789.697560:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919789.697564:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697570:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915611 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697694:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915603 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3927c expref: 12 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697719:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:1.0:1790919789.697721:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790919789.697726:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3927c expref: 12 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.697735:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:1.0:1790919789.697855:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+11:18949:x1877914958324096:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1355us (1530us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1790919789.697863:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1790919789.701458:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.701534:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324224 00000100:00100000:1.0:1790919789.701545:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324224 00000100:00100000:1.0:1790919789.701611:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1790919789.701621:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+11:18949:x1877914958324224:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919789.701657:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.701678:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591561f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39283 expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701763:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701777:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701787:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.701813:0:24409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790919789.701829:0:24409:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919789.701852:0:24409:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701880:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad1591561f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 13 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701911:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 12 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.701921:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919789.701924:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790919789.701928:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166ca00, rc 0) 00000100:00100000:1.0:1790919789.702353:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+12:18949:x1877914958324224:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 731us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.702362:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1790919789.706606:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.706859:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324352 00000100:00100000:1.0:1790919789.706869:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324352 00000100:00100000:1.0:1790919789.706928:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1790919789.706939:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+12:18949:x1877914958324352:12345-192.168.203.11@tcp:37:lfs.0 00000100:00100000:1.0:1790919789.711851:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+12:18949:x1877914958324352:12345-192.168.203.11@tcp:37:lfs.0 Request processed in 4903us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.711865:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919789.715611:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919789.715698:0:21907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324608 00000100:00100000:3.0:1790919789.715709:0:21907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324608 00000100:00100000:3.0:1790919789.715761:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919789.715770:0:21907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2859fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+12:18949:x1877914958324608:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1790919789.715990:0:21907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2859fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+13:18949:x1877914958324608:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 220us (397us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1790919789.716007:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1790919789.765953:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919789.766083:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324736 00000100:00100000:2.0:1790919789.766094:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324736 00000100:00100000:2.0:1790919789.766149:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1790919789.766158:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+11:18955:x1877914958324736:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919789.766185:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919789.766205:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad1591562d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3928a expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766264:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766278:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766304:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766316:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766323:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766329:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766408:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15915642 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766415:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15915642 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766421:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15915642 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919789.766445:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790919789.766448:0:21904:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919789.766485:0:21904:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15915642 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766497:0:21904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766504:0:21904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766520:0:21904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766527:0:21904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919789.766531:0:21904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766538:0:21904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766550:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:2.0:1790919789.766553:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919789.766557:0:21904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766563:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1400/0x951c50ad15915634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766576:0:21904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766582:0:21904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766587:0:21904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766602:0:21904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a1200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919789.766606:0:21904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766620:0:21904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766628:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3904a5c00) 00010000:00010000:2.0:1790919789.766630:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919789.766633:0:21904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766639:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a1200/0x951c50ad1591563b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766662:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0400/0x951c50ad1591562d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3928a expref: 13 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766673:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696000/0x951c50ad15915642 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3928a expref: 12 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.766680:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919789.766683:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790919789.766685:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696000, rc 0) 00000100:00100000:2.0:1790919789.766731:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+12:18955:x1877914958324736:12345-192.168.203.11@tcp:101:bash.0 Request processed in 575us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.766739:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1790919789.770865:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.770971:0:21914:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958324864 00000100:00100000:1.0:1790919789.770981:0:21914:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958324864 00000100:00100000:1.0:1790919789.771038:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919789.771047:0:21914:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18955:x1877914958324864:12345-192.168.203.11@tcp:900:bash.0 00000100:00100000:0.0:1790919789.771690:0:21914:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:18955:x1877914958324864:12345-192.168.203.11@tcp:900:bash.0 Request processed in 641us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.771704:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1790919789.778314:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.778410:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958325120 00000100:00100000:1.0:1790919789.778421:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958325120 00000100:00100000:1.0:1790919789.778479:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1790919789.778490:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+12:18955:x1877914958325120:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1790919789.778513:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.778532:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15915649 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39291 expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.778794:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.778811:0:24409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 12 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.778820:0:24409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.778854:0:24409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 12 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.778867:0:24409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 12 pid: 24409 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919789.778879:0:24409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24409:1877914978340608:192.168.203.11@tcp:104: 00000100:00100000:1.0:1790919789.779009:0:24409:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f284259240 going to sleep for 11 seconds 00000100:00100000:1.0:1790919789.782370:0:24409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24409:1877914978340608:192.168.203.11@tcp:104: 00010000:00010000:1.0:1790919789.782400:0:24409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919789.783615:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919789.784440:0:21890:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958325248 00000100:00100000:2.0:1790919789.784453:0:21890:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958325248 00010000:00010000:2.0:1790919789.784543:0:21890:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 13 pid: 24409 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919789.784611:0:21890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1790919789.784623:0:21890:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+13:2413:x1877914958325248:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919789.784643:0:21890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919789.784650:0:21890:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 13 pid: 24409 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784662:0:21890:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 13 pid: 24409 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784685:0:21890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915626 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39283 expref: 13 pid: 24409 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784704:0:21890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919789.784709:0:21890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784719:0:21890:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784727:0:21890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.784822:0:21890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919789.784889:0:21890:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+12:2413:x1877914958325248:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 268us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.784906:0:21890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00010000:00010000:1.0:1790919789.788077:0:24409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.788094:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.788125:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.788138:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.788149:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789816:0:24409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789832:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789842:0:24409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.789854:0:24409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790919789.789897:0:24409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789905:0:24409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789912:0:24409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789930:0:24409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919789.789934:0:24409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789942:0:24409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.789952:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:1.0:1790919789.789955:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790919789.789960:0:24409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.790689:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad15915650 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790919789.790716:0:24409:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004f34a811 reply state 00000000a822ce0c transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.790727:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.790735:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff95f392142100) 00010000:00010000:1.0:1790919789.790737:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919789.790741:0:24409:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790919789.790783:0:24409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15915649 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 15 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.790813:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 14 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.790834:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919789.790836:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790919789.790839:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c200, rc 0) 00000100:00100000:1.0:1790919789.790902:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+15:18955:x1877914958325120:12345-192.168.203.11@tcp:101:bash.0 Request processed in 12413us (12597us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1790919789.790910:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1790919789.802324:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919789.802540:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958325376 00000100:00100000:2.0:1790919789.802566:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958325376 00000100:00100000:2.0:1790919789.802702:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1790919789.802715:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+15:18955:x1877914958325376:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1790919789.802743:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790919789.802765:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696800/0x951c50ad1591566c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f39298 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.802837:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.802853:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.802865:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790919789.802916:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790919789.802921:0:21904:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790919789.802940:0:21904:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.802950:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.802984:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696800/0x951c50ad1591566c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 17 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.803005:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 16 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919789.803013:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:2.0:1790919789.803022:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790919789.803026:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f381696200, rc 0) 00000100:00100000:2.0:1790919789.803144:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+16:18955:x1877914958325376:12345-192.168.203.11@tcp:101:bash.0 Request processed in 432us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919789.803151:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1790919789.807275:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919789.807419:0:21907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958325632 00000100:00100000:3.0:1790919789.807429:0:21907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958325632 00000100:00100000:3.0:1790919789.807521:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1790919789.807532:0:21907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+16:18955:x1877914958325632:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1790919789.807939:0:21907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+17:18955:x1877914958325632:12345-192.168.203.11@tcp:35:bash.0 Request processed in 408us (672us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1790919789.807947:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:0.0:1790919789.895666:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919789.895764:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958325888 00000100:00100000:3.0:1790919789.895788:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958325888 00000100:00100000:3.0:1790919789.895848:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1790919789.895858:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+17:18965:x1877914958325888:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1790919789.895882:0:21903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919789.895904:0:21903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591567a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f3929f expref: -99 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919789.896003:0:21903:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790919789.896161:0:21903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591567a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3929f expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.896175:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95f392142500) 00010000:00010000:3.0:1790919789.896177:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919789.896182:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591567a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f3929f expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.896195:0:21903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfdf000, rc 0) 00000100:00100000:3.0:1790919789.896245:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+18:18965:x1877914958325888:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 389us (588us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1790919789.896252:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1790919789.900031:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.900182:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958326144 00000100:00100000:1.0:1790919789.900192:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958326144 00000100:00100000:1.0:1790919789.900240:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1790919789.900249:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+18:18965:x1877914958326144:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919789.900473:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:18965:x1877914958326144:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 224us (450us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1790919789.900482:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1790919789.933017:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.933221:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958326400 00000100:00100000:1.0:1790919789.933231:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958326400 00000100:00100000:1.0:1790919789.933286:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1790919789.933295:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:18968:x1877914958326400:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1790919789.933318:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919789.933338:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15915688 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392a6 expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.933427:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad1591568f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.933440:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad1591568f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.933457:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad1591568f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919789.933468:0:21905:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790919789.933580:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad15915688 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392a6 expref: 22 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.933619:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad1591568f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392a6 expref: 21 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.933734:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919789.933738:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790919789.933742:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:1.0:1790919789.933796:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:18968:x1877914958326400:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 501us (786us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1790919789.933803:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1790919789.940967:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919789.941014:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.941170:0:21891:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958326656 00000100:00100000:1.0:1790919789.941180:0:21891:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958326656 00000100:00100000:1.0:1790919789.941247:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:1.0:1790919789.941259:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:2412:x1877914958326656:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790919789.941275:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790919789.941299:0:21891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad1591568f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392a6 expref: 21 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919789.941318:0:21891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919789.941323:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790919789.941403:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+20:2412:x1877914958326656:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 146us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919789.941411:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1790919789.941938:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958326528 00000100:00100000:3.0:1790919789.941945:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958326528 00000100:00100000:3.0:1790919789.941991:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1790919789.942000:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+20:18968:x1877914958326528:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1790919789.942092:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942107:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942139:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942168:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942176:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942183:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942188:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919789.942193:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942201:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942211:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919789.942214:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919789.942218:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919789.942224:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad1591569d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919789.942287:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+20:18968:x1877914958326528:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 287us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919789.942294:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1790919789.946634:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919789.946723:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958326912 00000100:00100000:1.0:1790919789.946733:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958326912 00000100:00100000:1.0:1790919789.946791:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919789.946801:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+20:18968:x1877914958326912:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1790919789.947039:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:18968:x1877914958326912:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 238us (413us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1790919789.947047:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1790919789.980339:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978340736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790919789.980418:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919789.980785:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978340736 00000100:00100000:0.0:1790919789.980793:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978340736 00000100:00100000:0.0:1790919789.980863:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790919789.980875:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978340736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790919789.980915:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1790919789.980971:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978340736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919789.980978:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790919789.981369:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919789.981901:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978340736:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790919790.110752:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919790.189269:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919790.189485:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958327168 00000100:00100000:3.0:1790919790.189496:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958327168 00000100:00100000:3.0:1790919790.189557:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1790919790.189568:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:18999:x1877914958327168:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1790919790.189607:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919790.189627:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392ad expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.189728:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde000/0x951c50ad159156ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.189742:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde000/0x951c50ad159156ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.189754:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde000/0x951c50ad159156ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919790.189765:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790919790.189917:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ad expref: 24 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.189934:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde000/0x951c50ad159156ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ad expref: 23 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.189943:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919790.189945:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919790.189948:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfde000, rc 0) 00000100:00100000:3.0:1790919790.190032:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:18999:x1877914958327168:12345-192.168.203.11@tcp:101:cat.0 Request processed in 466us (773us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1790919790.190093:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1790919790.194490:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919790.194632:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958327424 00000100:00100000:1.0:1790919790.194652:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958327424 00000100:00100000:1.0:1790919790.194710:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1790919790.194720:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:18999:x1877914958327424:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:1.0:1790919790.195043:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+24:18999:x1877914958327424:12345-192.168.203.11@tcp:35:cat.0 Request processed in 324us (562us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1790919790.195075:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:0.0:1790919790.197965:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919790.198550:0:21889:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958327552 00000100:00100000:2.0:1790919790.198562:0:21889:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958327552 00000100:00100000:2.0:1790919790.198730:0:21889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919790.198741:0:21889:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+24:2412:x1877914958327552:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919790.198756:0:21889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919790.198780:0:21889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde000/0x951c50ad159156ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ad expref: 24 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919790.198798:0:21889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:2.0:1790919790.198803:0:21889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919790.198865:0:21889:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:2412:x1877914958327552:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 126us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919790.198872:0:21889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1790919790.238311:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919790.238393:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958327808 00000100:00100000:3.0:1790919790.238404:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958327808 00000100:00100000:3.0:1790919790.238465:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1790919790.238476:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:19005:x1877914958327808:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790919790.238503:0:21903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919790.238525:0:21903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156b9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392b4 expref: -99 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238649:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238664:0:21903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 24 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238672:0:21903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 24 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238679:0:21903:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238710:0:21903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 24 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238724:0:21903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 24 pid: 21904 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919790.238736:0:21903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21903:1877914978340864:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919790.238845:0:21903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 24 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.238854:0:21903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 24 pid: 24409 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919790.238862:0:21903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21903:1877914978340992:192.168.203.11@tcp:104: 00000100:00100000:3.0:1790919790.238885:0:21903:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3b66f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790919790.241625:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919790.241668:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919790.241788:0:24651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958327936 00000100:00100000:0.0:1790919790.241796:0:24651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958327936 00010000:00010000:0.0:1790919790.241831:0:24651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 25 pid: 21904 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919790.241864:0:24651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328064 00000100:00100000:0.0:1790919790.241866:0:24651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328064 00010000:00010000:0.0:1790919790.241875:0:24651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 26 pid: 24409 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919790.241894:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790919790.241902:0:24651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:2413:x1877914958327936:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919790.241914:0:24651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919790.241919:0:24651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 26 pid: 21904 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.241948:0:24651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 26 pid: 21904 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.241969:0:24651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:0.0:1790919790.241974:0:24651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.241983:0:24651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.241999:0:24651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919790.242044:0:24651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:2413:x1877914958327936:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919790.242072:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1790919790.242092:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1790919790.242098:0:24651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+25:2413:x1877914958328064:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790919790.242106:0:24651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919790.242110:0:24651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 25 pid: 24409 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.242119:0:24651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 25 pid: 24409 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.242140:0:24651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:0.0:1790919790.242144:0:24651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.242161:0:24651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.242168:0:24651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.242183:0:24651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919790.242201:0:24651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f283a73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+25:2413:x1877914958328064:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 102us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919790.242207:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:3.0:1790919790.243188:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381696200/0x951c50ad15915673 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39298 expref: 24 pid: 21904 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919790.243209:0:21903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21903:1877914978340864:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919790.243219:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591565e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f39291 expref: 23 pid: 24409 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919790.243228:0:21903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21903:1877914978340992:192.168.203.11@tcp:104: 00010000:00010000:3.0:1790919790.243247:0:21903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.243256:0:21903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.243262:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919790.243281:0:21903:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790919790.243432:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156b9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392b4 expref: 24 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.243460:0:21903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde400/0x951c50ad159156c0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392b4 expref: 23 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.243468:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919790.243471:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790919790.243473:0:21903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfde400, rc 0) 00000100:00100000:3.0:1790919790.243508:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:19005:x1877914958327808:12345-192.168.203.11@tcp:101:dd.0 Request processed in 5036us (5208us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1790919790.243515:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1790919790.248732:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919790.248790:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328320 00000100:00100000:1.0:1790919790.248800:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328320 00000100:00100000:1.0:1790919790.248855:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1790919790.248864:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+23:19005:x1877914958328320:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:1.0:1790919790.249289:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.249307:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.249333:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790919790.249390:0:21905:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1790919790.249413:0:21905:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d8b91a99 reply state 00000000a31625ef transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.249425:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.249432:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919790.249435:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790919790.249438:0:21905:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790919790.249569:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328320:12345-192.168.203.11@tcp:36:dd.0 Request processed in 705us (844us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1790919790.249576:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000020:00080000:1.0:1790919790.249581:0:21905:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790919790.253648:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919790.253796:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328448 00000100:00100000:1.0:1790919790.253807:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328448 00000100:00100000:1.0:1790919790.253864:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1790919790.253874:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328448:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:1.0:1790919790.253897:0:24409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919790.253915:0:24409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159156d5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392bb expref: -99 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.253972:0:24409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159156d5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392bb expref: 27 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.253996:0:24409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159156d5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392bb expref: 27 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919790.254032:0:24409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919790.254036:0:24409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919790.254039:0:24409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c800, rc 0) 00000100:00100000:1.0:1790919790.254481:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19005:x1877914958328448:12345-192.168.203.11@tcp:101:dd.0 Request processed in 607us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919790.254489:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1790919790.270714:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919790.270962:0:24651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328704 00000100:00100000:0.0:1790919790.270974:0:24651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328704 00000100:00100000:0.0:1790919790.271048:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919790.271096:0:24651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19005:x1877914958328704:12345-192.168.203.11@tcp:103:dd.0 00010000:00010000:0.0:1790919790.271111:0:24651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790919790.271135:0:24651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c800/0x951c50ad159156d5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392bb expref: 27 pid: 24409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919790.271154:0:24651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:0.0:1790919790.271158:0:24651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790919790.271209:0:24651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328704:12345-192.168.203.11@tcp:103:dd.0 Request processed in 116us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919790.271217:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1790919790.273484:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919790.273566:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328832 00000100:00100000:3.0:1790919790.273578:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328832 00000100:00100000:3.0:1790919790.273646:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:3.0:1790919790.273656:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328832:12345-192.168.203.11@tcp:58:dd.0 00010000:00010000:3.0:1790919790.273755:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.273774:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.273787:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919790.274633:0:21904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790919790.274787:0:21904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1790919790.274861:0:21904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1790919790.274969:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328832:12345-192.168.203.11@tcp:58:dd.0 Request processed in 1312us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919790.274989:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:1.0:1790919790.277777:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919790.277855:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958328960 00000100:00100000:3.0:1790919790.277864:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958328960 00000100:00100000:3.0:1790919790.277919:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1790919790.277928:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+26:19005:x1877914958328960:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:3.0:1790919790.277947:0:21903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919790.277967:0:21903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392c2 expref: -99 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278098:0:21903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278110:0:21903:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 27 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278346:0:21903:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278363:0:21903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 27 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278376:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919790.278379:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790919790.278382:0:21903:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 27 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919790.278390:0:21903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfdee00, rc 0) 00000100:00100000:3.0:1790919790.278457:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19005:x1877914958328960:12345-192.168.203.11@tcp:101:dd.0 Request processed in 531us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919790.278465:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00010000:00010000:2.0:1790919790.684559:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790919791.133998:0:21937:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790919791.134007:0:21937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919791.134047:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790919791.134079:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1790919791.134214:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21937:1877914978341120:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790919791.134444:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3954d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1790919791.143023:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21937:1877914978341120:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790919791.158894:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.159192:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958329088 00000100:00100000:3.0:1790919791.159203:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958329088 00000100:00100000:3.0:1790919791.159278:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1790919791.159289:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3a9a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19006:x1877914958329088:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919791.159320:0:21904:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919791.159457:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3a9a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19006:x1877914958329088:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 170us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.159476:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00080000:2.0:1790919791.159596:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790919791.162777:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.163229:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958329216 00000100:00100000:3.0:1790919791.163239:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958329216 00000100:00100000:3.0:1790919791.163294:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919791.163306:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19006:x1877914958329216:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.163386:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163404:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163417:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163475:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163483:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163507:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163534:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163543:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163550:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919791.163600:0:21903:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790919791.163605:0:21903:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790919791.163629:0:21903:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163641:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163648:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163656:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163662:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.163666:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163674:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163691:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f385107300) 00010000:00010000:3.0:1790919791.163694:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.163699:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163705:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf400/0x951c50ad159156ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163718:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163725:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163731:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163736:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.163739:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163744:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163752:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff95f3930c1300) 00010000:00010000:3.0:1790919791.163754:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.163757:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163763:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad159156f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163791:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163797:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163803:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163807:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.163810:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163816:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163824:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919791.163826:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.163828:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.163834:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad159156f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919791.163912:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19006:x1877914958329216:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 608us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.163920:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:0.0:1790919791.168426:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.168697:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958329472 00000100:00100000:3.0:1790919791.168708:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958329472 00000100:00100000:3.0:1790919791.168761:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:3.0:1790919791.168776:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+27:19006:x1877914958329472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.168798:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919791.168816:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad159156ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392c9 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.168905:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.168920:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.168930:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790919791.168941:0:21904:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790919791.169038:0:21904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169047:0:21904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169095:0:21904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169101:0:21904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.169106:0:21904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169114:0:21904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169124:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919791.169139:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919791.169144:0:21904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169151:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad15915706 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169187:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad159156ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c9 expref: 29 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169196:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff95f385107300) 00010000:00010000:3.0:1790919791.169198:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790919791.169202:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad159156ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c9 expref: 29 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.169211:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfdea00, rc 0) 00000100:00100000:3.0:1790919791.169259:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+28:19006:x1877914958329472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 484us (841us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1790919791.169266:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1790919791.173348:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.173813:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958329600 00000100:00100000:3.0:1790919791.173825:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958329600 00000100:00100000:3.0:1790919791.173888:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1790919791.173899:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+28:19006:x1877914958329600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790919791.173936:0:21903:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790919791.174095:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+28:19006:x1877914958329600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 196us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.174103:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:0.0:1790919791.188344:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.188493:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958329856 00000100:00100000:3.0:1790919791.188521:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958329856 00000100:00100000:3.0:1790919791.188592:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1790919791.188603:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+28:19006:x1877914958329856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.188626:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919791.188646:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad15915714 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392d0 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790919791.189351:0:21904:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1790919791.189359:0:21904:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1790919791.189410:0:21904:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1790919791.189668:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad1591571b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.189684:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad1591571b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.189695:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad1591571b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.189757:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad15915714 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392d0 expref: 31 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.189775:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad1591571b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392d0 expref: 30 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.189785:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1300) 00010000:00010000:3.0:1790919791.189788:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790919791.189791:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfde800, rc 0) 00000100:00100000:3.0:1790919791.189854:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+30:19006:x1877914958329856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1253us (1522us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1790919791.189869:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1790919791.199266:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.199384:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958330112 00000100:00100000:2.0:1790919791.199395:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958330112 00000100:00100000:2.0:1790919791.199457:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1790919791.199479:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+30:19006:x1877914958330112:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919791.199543:0:21903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919791.199572:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde800/0x951c50ad1591571b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392d0 expref: 30 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199603:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1300) 00010000:00010000:2.0:1790919791.199614:0:21903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919791.199648:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199661:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199672:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199686:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199712:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199720:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199784:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199791:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199798:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199803:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919791.199807:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199815:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199822:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:2.0:1790919791.199825:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919791.199830:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199835:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697600/0x951c50ad15915729 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199845:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199857:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199862:0:21903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199867:0:21903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1790919791.199870:0:21903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199877:0:21903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199885:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3f4e5c45 (ffff95f3904a5100) 00010000:00010000:2.0:1790919791.199887:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790919791.199890:0:21903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.199895:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915730 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3f4e5c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.199972:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+29:19006:x1877914958330112:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 506us (717us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790919791.199979:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1790919791.204312:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.204392:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958330240 00000100:00100000:3.0:1790919791.204402:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958330240 00000100:00100000:3.0:1790919791.204460:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1790919791.204480:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+29:19006:x1877914958330240:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.204502:0:21904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790919791.204526:0:21904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad15915737 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392d7 expref: -99 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204561:0:21904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad1591573e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204574:0:21904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad1591573e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204596:0:21904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad1591573e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204864:0:21904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdea00/0x951c50ad15915737 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392d7 expref: 31 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204881:0:21904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf200/0x951c50ad1591573e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392d7 expref: 30 pid: 21904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.204891:0:21904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919791.204893:0:21904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790919791.204896:0:21904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38dfdf200, rc 0) 00000100:00100000:3.0:1790919791.204957:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+30:19006:x1877914958330240:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 478us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.204971:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1790919791.212010:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.212153:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958330496 00000100:00100000:3.0:1790919791.212164:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958330496 00000100:00100000:3.0:1790919791.212214:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:3.0:1790919791.212225:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+30:19006:x1877914958330496:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.212311:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.212330:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.212341:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790919791.212877:0:21903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1790919791.212890:0:21903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 600240836496ns, next at 601240834259ns, rc = 0 00000004:00010000:3.0:1790919791.212967:0:21903:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a26adde7 reply state 00000000625a4c68 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.212980:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.212988:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919791.212991:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790919791.212995:0:21903:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790919791.213140:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+32:19006:x1877914958330496:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 915us (1139us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1790919791.213148:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1790919791.216035:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.216221:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958330624 00000100:00100000:1.0:1790919791.216235:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958330624 00000100:00100000:1.0:1790919791.216294:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790919791.216304:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+32:19006:x1877914958330624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919791.216330:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919791.216352:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392de expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.216415:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 33 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.216429:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 33 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.216447:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919791.216450:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919791.216454:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166d400, rc 0) 00000100:00100000:1.0:1790919791.216521:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+33:19006:x1877914958330624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 218us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919791.216544:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1790919791.220368:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.220547:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958330752 00000100:00100000:2.0:1790919791.220557:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958330752 00000100:00100000:2.0:1790919791.220645:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1790919791.220656:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2411:x1877914958330752:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790919791.221255:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2411:x1877914958330752:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 597us (894us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1790919791.221282:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00080000:0.0:1790919791.221453:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790919791.226472:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.226556:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331008 00000100:00100000:1.0:1790919791.226566:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331008 00000100:00100000:1.0:1790919791.226635:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919791.226645:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+33:19006:x1877914958331008:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790919791.226895:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+34:19006:x1877914958331008:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 249us (430us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1790919791.226903:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1790919791.230150:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.230286:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331264 00000100:00100000:3.0:1790919791.230321:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331264 00000100:00100000:3.0:1790919791.230369:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1790919791.230377:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+34:19006:x1877914958331264:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919791.230492:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+34:19006:x1877914958331264:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.230500:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1790919791.235190:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.235396:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331392 00000100:00100000:1.0:1790919791.235406:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331392 00000100:00100000:1.0:1790919791.235464:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790919791.235474:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+34:19006:x1877914958331392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790919791.235496:0:21905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790919791.235516:0:21905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915753 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392e5 expref: -99 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235617:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235633:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235644:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790919791.235690:0:21905:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790919791.235709:0:21905:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235816:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166ca00/0x951c50ad15915753 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392e5 expref: 36 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235835:0:21905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392e5 expref: 35 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.235844:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919791.235846:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790919791.235850:0:21905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f38166c200, rc 0) 00000100:00100000:1.0:1790919791.236025:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+35:19006:x1877914958331392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 551us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919791.236033:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1790919791.248283:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919791.248881:0:23210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331520 00000100:00100000:0.0:1790919791.248895:0:23210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331520 00000100:00100000:0.0:1790919791.248960:0:23210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919791.248971:0:23210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+6:2411:x1877914958331520:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790919791.249003:0:23210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790919791.249023:0:23210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x472a9c1ac4f392ec expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790919791.249077:0:23210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abf446f, blocks: 0x1 00010000:00010000:0.0:1790919791.249100:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=600s v=(0 0) 00010000:00010000:0.0:1790919791.249104:0:23210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919791.249114:0:23210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 7 pid: 23210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.249147:0:23210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 7 pid: 23210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.249182:0:23210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95f3a68c1400, rc 0) 00000100:00100000:0.0:1790919791.249310:0:23210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2411:x1877914958331520:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 341us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919791.249317:0:23210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1790919791.257104:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.257218:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331776 00000100:00100000:3.0:1790919791.257228:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331776 00000100:00100000:3.0:1790919791.257283:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:3.0:1790919791.257293:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+35:19006:x1877914958331776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790919791.257408:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+35:19006:x1877914958331776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 115us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.257415:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1790919791.266166:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.266264:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958331904 00000100:00100000:3.0:1790919791.266275:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958331904 00000100:00100000:3.0:1790919791.266385:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1790919791.266397:0:21904:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+35:19006:x1877914958331904:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790919791.326932:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901889 is committed 00000001:00080000:3.0:1790919791.326956:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000001:00080000:3.0:1790919791.326987:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000004:00080000:3.0:1790919791.327004:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790919791.327024:0:6467:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1790919791.327099:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327111:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327130:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327137:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327141:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327149:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327164:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff95f3904a5c00) 00010000:00010000:3.0:1790919791.327167:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.327172:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327179:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0200/0x951c50ad15915585 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327200:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327206:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327212:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327217:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3857a0c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327221:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327238:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327246:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919791.327248:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.327251:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327257:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3857a0c00/0x951c50ad1591558c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327271:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327277:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327283:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327288:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327291:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327297:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327318:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff95f392142100) 00010000:00010000:3.0:1790919791.327320:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.327323:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327336:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d800/0x951c50ad15915657 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327363:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327370:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327376:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327381:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327383:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327389:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327397:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:3.0:1790919791.327400:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790919791.327402:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327408:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166de00/0x951c50ad159156ce lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327420:0:3444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327426:0:3444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327438:0:3444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327443:0:3444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327446:0:3444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327453:0:3444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327461:0:3444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:3.0:1790919791.327463:0:3444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790919791.327466:0:3444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327470:0:3444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf600/0x951c50ad15915745 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327498:0:3445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327505:0:3445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327510:0:3445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327515:0:3445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1790919791.327518:0:3445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327533:0:3445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327542:0:3445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff95f3904a5700) 00010000:00010000:3.0:1790919791.327543:0:3445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790919791.327546:0:3445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.327551:0:3445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfde200/0x951c50ad159155fc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919791.327850:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978341248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790919791.327913:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.327959:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978341248 00000100:00100000:3.0:1790919791.327966:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978341248 00000100:00100000:3.0:1790919791.328007:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790919791.328015:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978341248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790919791.328186:0:23212:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790919791.328190:0:23212:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790919791.328192:0:23212:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790919791.328194:0:23212:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790919791 -> 1790919791 00002000:00010000:3.0:1790919791.328197:0:23212:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790919791.328234:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3460:x1877914978341248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (321us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790919791.328243:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1790919791.328271:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1790919791.328376:0:3460:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95f39eae0000/2, rc 0, transno 12884901892 00000100:00100000:3.0:1790919791.328383:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978341248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790919791.328629:0:21904:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+14:19006:x1877914958331904:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 62226us (62466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.328638:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1790919791.331157:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.331535:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332032 00000100:00100000:2.0:1790919791.331546:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332032 00000100:00100000:2.0:1790919791.331615:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1790919791.331635:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2411:x1877914958332032:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790919791.331754:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2411:x1877914958332032:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 121us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.331762:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1790919791.334712:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.334844:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332288 00000100:00100000:2.0:1790919791.334854:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332288 00000100:00100000:2.0:1790919791.334914:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1790919791.334924:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+14:19006:x1877914958332288:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790919791.334989:0:21903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919791.335016:0:21903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166c200/0x951c50ad1591575a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392e5 expref: 14 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.335034:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919791.335038:0:21903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790919791.335291:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915768 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.335373:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915768 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.335402:0:21903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915768 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790919791.335601:0:21903:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000730ae247 reply state 00000000a38cbc83 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915768 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.335615:0:21903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f381697200/0x951c50ad15915768 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.335688:0:21903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919791.335691:0:21903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790919791.335694:0:21903:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790919791.339308:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+15:19006:x1877914958332288:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 4374us (4593us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1790919791.339321:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1790919791.349039:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919791.349146:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332416 00000100:00100000:0.0:1790919791.349155:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332416 00000100:00100000:0.0:1790919791.349203:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1790919791.349213:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2411:x1877914958332416:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790919791.349404:0:24151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790919791.349408:0:24151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790919790 00002000:00010000:0.0:1790919791.349411:0:24151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790919790 00002000:00010000:0.0:1790919791.349413:0:24151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790919791 -> 1790919790 00002000:00010000:0.0:1790919791.349416:0:24151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790919791.349478:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ac371f0a-d44f-4a58-a70e-41d5105704e6+8:2411:x1877914958332416:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 265us (447us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1790919791.349486:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1790919791.352657:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.352770:0:23209:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332544 00000100:00100000:3.0:1790919791.352780:0:23209:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332544 00000100:00100000:3.0:1790919791.352832:0:23209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1790919791.352840:0:23209:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3beefcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+8:2412:x1877914958332544:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790919791.352887:0:23209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352905:0:23209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919791.352910:0:23209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919791.352917:0:23209:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352932:0:23209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352961:0:23209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352970:0:23209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352988:0:23209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.352996:0:23209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:3.0:1790919791.353013:0:23209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.353023:0:23209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.353038:0:23209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.353046:0:23209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad1591576f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919791.353155:0:23209:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3beefcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+8:2412:x1877914958332544:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 314us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.353162:0:23209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1790919791.355955:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919791.356049:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332800 00000100:00100000:0.0:1790919791.356083:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332800 00000100:00100000:0.0:1790919791.356134:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1790919791.356142:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+15:19006:x1877914958332800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790919791.356220:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356254:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356265:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356509:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356521:0:21905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 16 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356530:0:21905:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356565:0:21905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 16 pid: 21905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.356590:0:21905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 16 pid: 21905 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.356605:0:21905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21905:1877914978341376:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919791.356805:0:21905:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3914469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919791.363149:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.363234:0:21891:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958332928 00000100:00100000:2.0:1790919791.363244:0:21891:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958332928 00010000:00010000:2.0:1790919791.363285:0:21891:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 17 pid: 21905 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.363464:0:21891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:2.0:1790919791.363474:0:21891:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+17:2413:x1877914958332928:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919791.363490:0:21891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919791.363496:0:21891:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 17 pid: 21905 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.363510:0:21891:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 17 pid: 21905 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.363547:0:21891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919791.363551:0:21891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.363561:0:21891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.363569:0:21891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.363598:0:21891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919791.363803:0:21891:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+17:2413:x1877914958332928:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 330us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.363811:0:21891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:0.0:1790919791.363931:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38166d400/0x951c50ad1591574c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392de expref: 16 pid: 21905 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.363962:0:21905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21905:1877914978341376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919791.363990:0:21905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.364007:0:21905:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.364014:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790919791.364203:0:21905:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1790919791.364345:0:21905:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1790919791.364393:0:21905:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1790919791.364461:0:21905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:21905:1877914978341504:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790919791.364508:0:21905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.364544:0:21905:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391446000 going to sleep for 11 seconds 00000100:00100000:1.0:1790919791.364657:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978341504 00000100:00100000:1.0:1790919791.364663:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978341504 00000100:00100000:1.0:1790919791.364701:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790919791.364708:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21905:x1877914978341504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790919791.364769:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21905:x1877914978341504:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919791.364782:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790919791.365044:0:21905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:21905:1877914978341504:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790919791.366206:0:21905:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1790919791.366281:0:21905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:21905:1877914978341632:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790919791.366506:0:21905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.366533:0:21905:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f3914469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790919791.366759:0:21908:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978341632 00000100:00100000:1.0:1790919791.366767:0:21908:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978341632 00000100:00100000:1.0:1790919791.366815:0:21908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919791.366823:0:21908:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21905:x1877914978341632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790919791.367012:0:21908:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21905:x1877914978341632:12345-0@lo:1000:mdt00_002.0 Request processed in 189us (506us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1790919791.367021:0:21908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790919791.367089:0:21905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:21905:1877914978341632:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790919791.367120:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367130:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367137:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367142:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919791.367146:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367153:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367168:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:1.0:1790919791.367171:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919791.367175:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367197:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0600/0x951c50ad1591577d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367228:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367234:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367239:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367244:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfdf000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1790919791.367246:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367251:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367259:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:1.0:1790919791.367261:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790919791.367267:0:21905:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367277:0:21905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367285:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.367358:0:21905:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdee00/0x951c50ad159156e3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392c2 expref: 19 pid: 21903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919791.367371:0:21905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21905:1877914978341760:192.168.203.11@tcp:105: 00000100:00100000:1.0:1790919791.367427:0:21905:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f398ced6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790919791.369711:0:21905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f383ebed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21905:1877914978341760:192.168.203.11@tcp:105: 00010000:00010000:0.0:1790919791.369739:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369748:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f38dfdf000/0x951c50ad159156dc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369778:0:21905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369792:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369813:0:21905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369823:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369829:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369835:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369840:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919791.369844:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369851:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369861:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:0.0:1790919791.369864:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790919791.369867:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369873:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0400/0x951c50ad15915784 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369883:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369888:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369901:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369905:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1790919791.369908:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369914:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369921:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff95f392142800) 00010000:00010000:0.0:1790919791.369924:0:21905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790919791.369927:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.369933:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0e00/0x951c50ad15915776 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.370181:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:19006:x1877914958332800:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 14037us (14232us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1790919791.370192:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:0.0:1790919791.370197:0:21905:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790919791.370484:0:21937:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790919791.370489:0:21937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790919791.370515:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790919791.370525:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790919791.370573:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.370706:0:21906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333056 00000100:00100000:2.0:1790919791.370712:0:21906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333056 00000100:00100000:2.0:1790919791.370803:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1790919791.370814:0:21906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f2859fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:19005:x1877914958333056:12345-192.168.203.11@tcp:49:dd.0 00000100:00100000:2.0:1790919791.371006:0:21906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f2859fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:19005:x1877914958333056:12345-192.168.203.11@tcp:49:dd.0 Request processed in 194us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.371014:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1790919791.373602:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.373782:0:21907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333312 00000100:00100000:1.0:1790919791.373792:0:21907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333312 00000100:00100000:1.0:1790919791.373898:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1790919791.373908:0:21907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+19:19006:x1877914958333312:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790919791.376840:0:21907:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790919791.377203:0:21907:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1790919791.377277:0:21907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377296:0:21907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377370:0:21907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377380:0:21907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377388:0:21907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377395:0:21907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.377468:0:21907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790919791.377634:0:21907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:19006:x1877914958333312:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 3723us (4036us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1790919791.377651:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000020:00080000:0.0:1790919791.377658:0:21907:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790919791.377764:0:22959:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790919791.377771:0:22959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.377784:0:22959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919791.377788:0:22959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.377796:0:22959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.377809:0:22959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff95f3930c1d00) 00010000:00010000:2.0:1790919791.377812:0:22959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790919791.377817:0:22959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.377823:0:22959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95f3a68c0c00/0x951c50ad1591578b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.377838:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919791.377840:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919791.377842:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790919791.393027:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.393098:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919791.393242:0:23216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333440 00000100:00100000:0.0:1790919791.393253:0:23216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333440 00000100:00100000:0.0:1790919791.393314:0:23216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333568 00000100:00100000:0.0:1790919791.393317:0:23216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333568 00000100:00100000:0.0:1790919791.393338:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1790919791.393346:0:23216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:2414:x1877914958333440:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:0.0:1790919791.393381:0:23216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.393402:0:23216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 9 pid: 23210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.393430:0:23216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919791.393434:0:23216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919791.393440:0:23216:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.393476:0:23216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 9 pid: 23210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.393489:0:23216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 9 pid: 23210 timeout: 700 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.393502:0:23216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:23216:1877914978341888:192.168.203.11@tcp:104: 00000100:00100000:0.0:1790919791.393600:0:23216:0:(client.c:2716:ptlrpc_set_wait()) set ffff95f391446840 going to sleep for 11 seconds 00000100:00100000:0.0:1790919791.396721:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.396802:0:23215:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1790919791.396812:0:23215:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1790919791.397100:0:23215:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333696 00000100:00100000:0.0:1790919791.397110:0:23215:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333696 00000100:00100000:3.0:1790919791.397769:0:24670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1790919791.397785:0:24670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:2414:x1877914958333568:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:3.0:1790919791.397824:0:24670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.397842:0:24670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919791.397846:0:24670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790919791.397851:0:24670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.397870:0:24670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919791.401857:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919791.401952:0:24651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333824 00000100:00100000:2.0:1790919791.401961:0:24651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333824 00010000:00010000:2.0:1790919791.402001:0:24651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 11 pid: 23210 timeout: 700 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.402044:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1790919791.402087:0:24651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+11:2414:x1877914958333824:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790919791.402102:0:24651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790919791.402124:0:24651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 11 pid: 23210 timeout: 700 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402157:0:24651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 11 pid: 23210 timeout: 700 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402186:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.402191:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.402197:0:24651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402208:0:24651:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402217:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.402232:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.402237:0:24651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402245:0:24651:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.402271:0:24651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790919791.402321:0:24651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+11:2414:x1877914958333824:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 268us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.402330:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00010000:00010000:1.0:1790919791.402601:0:24670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.402610:0:24670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.403434:0:23216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad15915761 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0x472a9c1ac4f392ec expref: 10 pid: 23210 timeout: 700 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.403451:0:23216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:23216:1877914978341888:192.168.203.11@tcp:104: 00010000:00010000:0.0:1790919791.403472:0:23216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.403482:0:23216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.403497:0:23216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919791.517821:0:3461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39eae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978342016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919791.517925:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.518046:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342016 00000100:00100000:3.0:1790919791.518077:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342016 00000100:00100000:3.0:1790919791.518152:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790919791.518163:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978342016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790919791.518198:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 54329344 pending 3407872 free 3851419648 avail 3849322496 00000100:00100000:3.0:1790919791.518253:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3461:x1877914978342016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.518261:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790919791.518288:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790919791.518333:0:3461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39eae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3461:1877914978342016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790919791.519020:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978342144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790919791.519098:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.519132:0:3458:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790919791.519139:0:3458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978342272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919791.519174:0:3458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.519530:0:23504:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342144 00000100:00100000:3.0:1790919791.519541:0:23504:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342144 00000100:00100000:3.0:1790919791.519603:0:23504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919791.519613:0:23504:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978342144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790919791.519684:0:23504:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790919791.519740:0:23504:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3458:x1877914978342144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.519749:0:23504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790919791.519774:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342272 00000100:00100000:3.0:1790919791.519778:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342272 00000100:00100000:3.0:1790919791.519806:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790919791.519813:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978342272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790919791.519840:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919791.519873:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3458:x1877914978342272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.519879:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790919791.519895:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790919791.519948:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3458:1877914978342272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790919791.519962:0:3458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3458:1877914978342144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790919791.521945:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978342400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.522074:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522121:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978342912:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.522155:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522177:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978343424:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.522208:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522235:0:3460:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790919791.522242:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978342528:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.522272:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522294:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978343040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.522317:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522334:0:3460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978343552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790919791.522358:0:3460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790919791.522394:0:24409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342912 00000100:00100000:0.0:1790919791.522403:0:24409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342912 00000100:00100000:2.0:1790919791.522645:0:21898:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342400 00000100:00100000:2.0:1790919791.522651:0:21898:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342400 00000100:00100000:2.0:1790919791.522712:0:21898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919791.522741:0:21898:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3460:x1877914978342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919791.522816:0:21898:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6+24:3460:x1877914978342400:12345-0@lo:400:kworker.0 Request processed in 77us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.522824:0:21898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790919791.522863:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343424 00000100:00100000:2.0:1790919791.522867:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343424 00000100:00100000:2.0:1790919791.522905:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343040 00000100:00100000:2.0:1790919791.522908:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343040 00000100:00100000:2.0:1790919791.522924:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919791.522931:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978343424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919791.522966:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3460:x1877914978343424:12345-0@lo:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.522984:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790919791.522999:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790919791.523005:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978343040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790919791.523034:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3460:x1877914978343040:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919791.523040:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790919791.523947:0:24409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790919791.523957:0:24409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978342912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.524035:0:24409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3460:x1877914978342912:12345-0@lo:400:kworker.0 Request processed in 79us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919791.524043:0:24409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790919791.524124:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3460:1877914978343040:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.524155:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d9ccb5e-2bab-4dd4-9f67-4a0d7d7496b6:3460:1877914978342400:0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.524167:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3460:1877914978342912:0@lo:400:kworker.0 00010000:00080000:0.0:1790919791.524182:0:3460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f382e26680 x1877914978343424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790919791.524193:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f382e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3460:1877914978343424:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.524917:0:23210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342528 00000100:00100000:3.0:1790919791.524930:0:23210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342528 00000100:00100000:3.0:1790919791.524998:0:23210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919791.525007:0:23210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978342528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525106:0:23210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978342528:12345-0@lo:400:kworker.0 Request processed in 100us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.525113:0:23210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790919791.525149:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978342784:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525195:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.525227:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978343296:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525279:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.525307:0:3459:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790919791.525315:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f39ebaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978342656:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525341:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.525363:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978343168:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525391:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.525605:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978343680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919791.525639:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790919791.525680:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342784 00000100:00100000:3.0:1790919791.525686:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342784 00000100:00100000:3.0:1790919791.525717:0:21909:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343680 00000100:00100000:3.0:1790919791.525720:0:21909:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343680 00000100:00100000:3.0:1790919791.525733:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919791.525740:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978342784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.525790:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3459:x1877914978342784:12345-0@lo:400:kworker.0 Request processed in 49us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.525797:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790919791.525812:0:21909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919791.525817:0:21909:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978343680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790919791.525855:0:21909:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790919791.525892:0:21909:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3459:x1877914978343680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.525900:0:21909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790919791.525918:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343296 00000100:00100000:3.0:1790919791.525922:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343296 00000100:00100000:3.0:1790919791.525949:0:21904:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978342656 00000100:00100000:3.0:1790919791.525951:0:21904:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978342656 00000100:00100000:0.0:1790919791.526428:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343168 00000100:00100000:0.0:1790919791.526435:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343168 00000100:00100000:0.0:1790919791.526463:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919791.526471:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978343296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.526519:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3459:x1877914978343296:12345-0@lo:400:kworker.0 Request processed in 49us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919791.526525:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790919791.526538:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919791.526544:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978342656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.526575:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3459:x1877914978342656:12345-0@lo:400:kworker.0 Request processed in 30us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919791.526592:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790919791.526604:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790919791.526609:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978343168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790919791.526641:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3459:x1877914978343168:12345-0@lo:400:kworker.0 Request processed in 32us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790919791.526646:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790919791.527419:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3459:1877914978342656:0@lo:400:kworker.0 00010000:00080000:3.0:1790919791.527440:0:3459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff95f3a001b800 x1877914978343168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790919807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790919791.527452:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a001b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3459:1877914978343168:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.527474:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978343680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790919791.527485:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3459:1877914978342784:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.527496:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3a0018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3459:1877914978343296:0@lo:400:kworker.0 00000100:00080000:3.0:1790919791.527546:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790919791.527554:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790919791.527557:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790919791.527586:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343552 00000100:00100000:3.0:1790919791.527593:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343552 00000100:00100000:3.0:1790919791.527633:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919791.527643:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978343552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790919791.527666:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790919791.527729:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3460:x1877914978343552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (5370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919791.527735:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790919791.527790:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f39ebaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978342528:0@lo:400:kworker.0 00000100:00100000:3.0:1790919791.527805:0:3460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f38d54aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3460:1877914978343552:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790919791.548136:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1790919791.548175:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:3.0:1790919791.548189:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:1.0:1790919791.548321:0:24670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1790919791.548327:0:24670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1790919790 -> 1790919792 00002000:00010000:1.0:1790919791.548330:0:24670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1790919791.548350:0:24670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548367:0:24670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548405:0:24670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548425:0:24670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38dfde200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919791.548431:0:24670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548444:0:24670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548473:0:24670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548481:0:24670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000208c3577/0x951c50ad15915799 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919791.548626:0:24670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+8:2414:x1877914958333568:12345-192.168.203.11@tcp:4:dd.0 Request processed in 150838us (155520us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1790919791.548646:0:24670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1790919791.548696:0:24670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1790919791.548711:0:24670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2414:x1877914958333696:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:1.0:1790919791.548754:0:24670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548769:0:24670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.548781:0:24670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.548880:0:24670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.548895:0:24670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549732:0:23216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549749:0:23216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549758:0:23216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549781:0:23216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c0e00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919791.549786:0:23216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549796:0:23216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549813:0:23216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.549822:0:23216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6a6e8e/0x951c50ad15915792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.549883:0:23216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f383ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2414:x1877914958333440:12345-192.168.203.11@tcp:4:dd.0 Request processed in 156534us (156863us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1790919791.549898:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000001:00080000:2.0:1790919791.631911:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:0.0:1790919791.632126:0:24670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1790919791.632131:0:24670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790919791.632162:0:24670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632175:0:24670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632183:0:24670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632190:0:24670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166d800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919791.632195:0:24670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632204:0:24670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632226:0:24670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.632234:0:24670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d8951bc/0x951c50ad159157a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.632436:0:24670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958333696:12345-192.168.203.11@tcp:4:dd.0 Request processed in 83724us (235717us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1790919791.632449:0:24670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1790919791.654465:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919791.654567:0:23215:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958333952 00000100:00100000:0.0:1790919791.654588:0:23215:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958333952 00000100:00100000:0.0:1790919791.654679:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1790919791.654690:0:23215:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958333952:12345-192.168.203.11@tcp:4:dd.0 00002000:00010000:0.0:1790919791.654753:0:23215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 3145728, mtime: 0x6abf4470, atime: 0x6abf446e, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1790919791.654763:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.654780:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=600s v=(0 0) 00010000:00010000:0.0:1790919791.654784:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790919791.654792:0:23215:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.654806:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790919791.660979:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.661035:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.661099:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919791.661119:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919791.662002:0:23217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334080 00000100:00100000:1.0:1790919791.662016:0:23217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334080 00000100:00100000:1.0:1790919791.662114:0:23217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334208 00000100:00100000:1.0:1790919791.662118:0:23217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334208 00000100:00100000:1.0:1790919791.662133:0:23217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334336 00000100:00100000:1.0:1790919791.662136:0:23217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334336 00000100:00100000:1.0:1790919791.662145:0:23217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334464 00000100:00100000:1.0:1790919791.662148:0:23217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334464 00000100:00100000:1.0:1790919791.662164:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1790919791.662174:0:23217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:2413:x1877914958334080:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:1.0:1790919791.662210:0:23217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.662228:0:23217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.662232:0:23217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.662238:0:23217:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.662252:0:23217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790919791.709740:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790919791.738720:0:23215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1790919791.738738:0:23215:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 0 -> 1790919792 00002000:00010000:2.0:1790919791.738742:0:23215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1790919791.738762:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738778:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738817:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738826:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f3a68c1400 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919791.738832:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738843:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738869:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.738877:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d9fa699/0x951c50ad159157a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.739156:0:23215:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d548e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+14:2413:x1877914958333952:12345-192.168.203.11@tcp:4:dd.0 Request processed in 84458us (84693us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1790919791.739170:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1790919791.739224:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1790919791.739515:0:23215:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39eae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+13:2414:x1877914958334208:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:2.0:1790919791.739587:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.739605:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.739620:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.739628:0:23215:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.739644:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790919791.739817:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00000001:00080000:1.0:1790919791.805803:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:2.0:1790919791.805938:0:23217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1790919791.805945:0:23217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1790919791.805964:0:23217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.805980:0:23217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.805990:0:23217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.805998:0:23217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:2.0:1790919791.806003:0:23217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.806015:0:23217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.806041:0:23217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.806082:0:23217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006223e2b/0x951c50ad159157ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790919791.806261:0:23217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+11:2413:x1877914958334080:12345-192.168.203.11@tcp:4:dd.0 Request processed in 144080us (145288us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1790919791.806273:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1790919791.806314:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1790919791.806328:0:23217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:2413:x1877914958334336:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:2.0:1790919791.806370:0:23217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.806384:0:23217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.806388:0:23217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790919791.806396:0:23217:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790919791.806410:0:23217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919791.859703:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:1.0:1790919791.860175:0:23215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1790919791.860182:0:23215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1790919791.860201:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860215:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860225:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860244:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381696800 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919791.860251:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860262:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860289:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860297:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf0fc1ab/0x951c50ad159157b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919791.860425:0:23215:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39eae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+10:2414:x1877914958334208:12345-192.168.203.11@tcp:4:dd.0 Request processed in 121183us (199380us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1790919791.860438:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1790919791.860494:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1790919791.860509:0:23215:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:2414:x1877914958334464:12345-192.168.203.11@tcp:4:dd.0 00010000:00010000:1.0:1790919791.860551:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860566:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.860571:0:23215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790919791.860589:0:23215:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.860603:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790919791.906832:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:0.0:1790919791.914396:0:23217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1790919791.914408:0:23217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1790919791.914432:0:23217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914448:0:23217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914460:0:23217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914469:0:23217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f381697c00 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:0.0:1790919791.914476:0:23217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914505:0:23217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914533:0:23217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790919791.914542:0:23217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d56633/0x951c50ad159157bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790919791.914673:0:23217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+9:2413:x1877914958334336:12345-192.168.203.11@tcp:4:dd.0 Request processed in 108342us (253565us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1790919791.914686:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00010000:00010000:1.0:1790919791.951930:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.951956:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.951966:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.952043:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95f38166c200 already unused, calling callback (ffffffffc144cac0) 00010000:00010000:1.0:1790919791.952050:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.952098:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.952140:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790919791.952149:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b53e7ab9/0x951c50ad159157c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790919791.952453:0:23215:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3ae849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+7:2414:x1877914958334464:12345-192.168.203.11@tcp:4:dd.0 Request processed in 91942us (291324us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1790919791.952466:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000001:00080000:2.0:1790919791.952680:0:8109:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901902 is committed 00000100:00100000:2.0:1790919792.590124:0:3452:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1790919792.590235:0:21896:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334592 00000100:00100000:3.0:1790919792.590249:0:21896:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334592 00000100:00100000:3.0:1790919792.590362:0:21896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1790919792.590375:0:21896:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2413:x1877914958334592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919792.590503:0:21896:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f3b5efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5848b4d0-1c03-47ed-8ac4-acdef81976e5+13:2413:x1877914958334592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919792.590511:0:21896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:0.0:1790919792.596186:0:3451:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919792.596274:0:21905:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334720 00000100:00100000:2.0:1790919792.596288:0:21905:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334720 00000100:00100000:2.0:1790919792.596367:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1790919792.596378:0:21905:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:2414:x1877914958334720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919792.596531:0:21905:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+21:2414:x1877914958334720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919792.596541:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1790919792.601558:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919792.601627:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919792.601673:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1790919792.601711:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1790919792.602098:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958335104 00000100:00100000:1.0:1790919792.602113:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958335104 00000100:00100000:1.0:1790919792.602197:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958335616 00000100:00100000:1.0:1790919792.602201:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958335616 00000100:00100000:1.0:1790919792.602227:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919792.602239:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958335104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919792.602345:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958335104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 108us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919792.602354:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1790919792.602375:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1790919792.602382:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958335616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919792.602422:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958335616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919792.602428:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1790919792.602979:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334848 00000100:00100000:3.0:1790919792.602989:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334848 00000100:00100000:3.0:1790919792.603040:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958335360 00000100:00100000:3.0:1790919792.603044:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958335360 00000100:00100000:3.0:1790919792.603103:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919792.603112:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958334848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919792.603169:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f382e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2413:x1877914958334848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919792.603176:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1790919792.603193:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:3.0:1790919792.603200:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f39ebaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958335360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1790919792.603226:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f39ebaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2413:x1877914958335360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790919792.603256:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00080000:0.0:1790919792.608589:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790919792.608608:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1790919792.613670:0:22558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790919792.614632:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919792.614675:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919792.614712:0:3453:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1790919792.614747:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958334976 00000100:00100000:2.0:1790919792.614760:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958334976 00000100:00100000:2.0:1790919792.614818:0:23212:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958335488 00000100:00100000:2.0:1790919792.614822:0:23212:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958335488 00000100:00100000:2.0:1790919792.614870:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919792.614881:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958334976:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919792.614990:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac371f0a-d44f-4a58-a70e-41d5105704e6+5:2414:x1877914958334976:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919792.614998:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1790919792.615016:0:23212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1790919792.615022:0:23212:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958335488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1790919792.615046:0:23212:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+5:2414:x1877914958335488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919792.615084:0:23212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1790919792.616865:0:21903:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914958335232 00000100:00100000:1.0:1790919792.616908:0:21903:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914958335232 00000100:00100000:1.0:1790919792.617018:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1790919792.617031:0:21903:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2414:x1877914958335232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1790919792.617167:0:21903:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f38d54b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20eb5a60-d1e0-4e2a-b22a-5a9ae841c93d+6:2414:x1877914958335232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 138us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790919792.617175:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00080000:0.0:1790919792.618000:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790919792.618009:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790919792.732501:0:21892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790919793.763347:0:22959:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790919793.872880:0:24710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1790919794.780300:0:21893:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790919795.104838:0:3459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978343808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790919795.104917:0:3459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790919795.105320:0:23214:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877914978343808 00000100:00100000:2.0:1790919795.105332:0:23214:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877914978343808 00000100:00100000:2.0:1790919795.105393:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790919795.105415:0:23214:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978343808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790919795.105453:0:23214:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3843031040 avail 3840933888 00000100:00100000:2.0:1790919795.105503:0:23214:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff95f391517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3459:x1877914978343808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790919795.105510:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790919795.106232:0:3459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1790919795.106239:0:3459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95f39eae0000, transno 12884901892 00000004:00080000:3.0:1790919795.106256:0:3459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1790919795.106289:0:3459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95f3ae849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3459:1877914978343808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790919795.106498:0:21899:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 13676 lines, 13676 kept, 0 dropped, 0 bad.