00010000:00010000:1.0F:1787853222.864422:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853223.432291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432518:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853223.432554:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741632 00000100:00100000:1.0:1787853223.432563:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741632 00000100:00100000:1.0:1787853223.432616:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742144 00000100:00100000:1.0:1787853223.432619:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742144 00000100:00100000:1.0:1787853223.432634:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741760 00000100:00100000:1.0:1787853223.432636:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741760 00000100:00100000:1.0:1787853223.432647:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742272 00000100:00100000:1.0:1787853223.432649:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742272 00000100:00100000:1.0:1787853223.432664:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1787853223.432674:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741632:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.432745:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741632:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 72us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.432753:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1787853223.432771:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1787853223.432777:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742144:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.432802:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742144:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.432808:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1787853223.432819:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1787853223.432834:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741760:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.432880:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741760:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.432887:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1787853223.432898:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1787853223.432904:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd29a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742272:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.432924:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd29a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742272:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.432929:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1787853223.432946:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741376 00000100:00100000:1.0:1787853223.432949:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741376 00000100:00100000:1.0:1787853223.432972:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741888 00000100:00100000:1.0:1787853223.432975:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741888 00000100:00100000:1.0:1787853223.432987:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741504 00000100:00100000:1.0:1787853223.432989:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741504 00000100:00100000:1.0:1787853223.433000:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742016 00000100:00100000:1.0:1787853223.433002:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742016 00000100:00100000:1.0:1787853223.433015:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1787853223.433021:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+22:2399:x1874699472741376:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.433062:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+22:2399:x1874699472741376:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.433068:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1787853223.433079:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1787853223.433085:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2399:x1874699472741888:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.433110:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2399:x1874699472741888:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.433121:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1787853223.433134:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1787853223.433140:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741504:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.433162:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2399:x1874699472741504:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.433168:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1787853223.433178:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1787853223.433184:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742016:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.433204:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2399:x1874699472742016:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.433209:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1787853223.433225:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472741248 00000100:00100000:1.0:1787853223.433228:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472741248 00000100:00100000:1.0:1787853223.433249:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:1.0:1787853223.433255:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf1774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2399:x1874699472741248:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853223.433272:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf1774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2399:x1874699472741248:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 18us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.433279:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00080000:1.0:1787853223.433306:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853223.433310:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853223.433312:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853223.433314:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0F:1787853223.568858:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491686400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853223.568950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1787853223.570509:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491686528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853223.570569:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853223.583366:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491686400 00000100:00100000:1.0:1787853223.583382:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491686400 00000100:00080000:2.0:1787853223.583598:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853223.583711:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491686528 00000100:00100000:1.0:1787853223.583728:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491686528 00000100:00100000:1.0:1787853223.583764:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853223.583772:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491686400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853223.583804:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787853223.583908:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491686400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (14958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.583926:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853223.583944:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853223.583951:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491686528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787853223.583960:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787853223.583991:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491686528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (13421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853223.583996:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853223.584042:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491686400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787853223.584264:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853223.584291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491686528:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787853223.889342:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853224.016541:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0F:1787853224.080588:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491686656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853224.080679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853224.081081:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491686656 00000100:00100000:0.0:1787853224.081089:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491686656 00000100:00100000:0.0:1787853224.081159:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853224.081170:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491686656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787853224.081207:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853224.081310:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491686784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853224.081355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853224.081391:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491686784 00000100:00100000:1.0:1787853224.081395:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491686784 00000100:00100000:1.0:1787853224.081419:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853224.081425:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491686784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853224.081443:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787853224.081480:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491686784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853224.081498:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853224.081540:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491686784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853224.086942:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491686656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5764us (6253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853224.086972:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853224.089399:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491686656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787853224.912108:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853225.110675:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1787853225.110696:0:17119:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfbfd8d7000 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:1.0:1787853225.110702:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc01d78500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfbfd8d7b40 00000020:00080000:1.0:1787853225.110705:0:17119:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc01d78600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfbc8700e00 00010000:00010000:0.0:1787853225.111236:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111250:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111258:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111265:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3c00 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:0.0:1787853225.111269:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111278:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111297:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfbfb601200) 00010000:00010000:0.0:1787853225.111301:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853225.111306:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853225.111326:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af2c61 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787853225.111355:0:17179:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1787853225.111424:0:17179:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787853225.937542:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853225.985407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853225.986575:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742400 00000100:00100000:2.0:1787853225.986592:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742400 00000100:00100000:2.0:1787853225.986681:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1787853225.986693:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+13:15579:x1874699472742400:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787853225.986808:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+13:15579:x1874699472742400:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 118us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853225.986816:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00080000:3.0:1787853225.986833:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853225.995386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853225.995419:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742528 00000100:00100000:2.0:1787853225.995430:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742528 00000100:00100000:2.0:1787853225.995508:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1787853225.995527:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47986e87-8752-448c-a7be-86cefabcf156+5:15579:x1874699472742528:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787853225.995620:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47986e87-8752-448c-a7be-86cefabcf156+5:15579:x1874699472742528:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 103us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853225.995627:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:3.0:1787853225.997051:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853226.009713:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853226.015819:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742784 00000100:00100000:2.0:1787853226.015835:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742784 00000100:00100000:2.0:1787853226.015922:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1787853226.015932:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47986e87-8752-448c-a7be-86cefabcf156+13:15579:x1874699472742784:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787853226.016373:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47986e87-8752-448c-a7be-86cefabcf156+14:15579:x1874699472742784:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 441us (6670us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787853226.016382:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1787853226.642527:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853226.642551:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac2f25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853226.642616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853226.643118:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491686912 00000100:00100000:1.0:1787853226.643125:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491686912 00000100:00100000:1.0:1787853226.643178:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853226.643187:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491686912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853226.643216:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853226.643257:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491686912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853226.643264:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787853226.643284:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853226.643387:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853226.643399:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491687040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787853226.643429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643596:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3645:1874699491687168:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643657:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491687680:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491688192:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643737:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787853226.643742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491687296:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643779:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491687808:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643816:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491688320:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.643884:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687168 00000100:00100000:0.0:1787853226.643889:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687168 00000100:00100000:0.0:1787853226.643929:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787853226.643936:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf1777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3645:x1874699491687168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.643985:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf1777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3645:x1874699491687168:12345-0@lo:400:kworker.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644002:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787853226.644032:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687680 00000100:00100000:0.0:1787853226.644036:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687680 00000100:00100000:0.0:1787853226.644068:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687296 00000100:00100000:0.0:1787853226.644070:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687296 00000100:00100000:0.0:1787853226.644084:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853226.644090:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491687680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644121:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491687680:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644127:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853226.644138:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853226.644143:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491687296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644168:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491687296:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644173:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853226.644190:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688192 00000100:00100000:0.0:1787853226.644193:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688192 00000100:00100000:0.0:1787853226.644219:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688320 00000100:00100000:0.0:1787853226.644221:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688320 00000100:00100000:0.0:1787853226.644236:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853226.644241:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491688192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644268:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491688192:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644282:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853226.644293:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853226.644298:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491688320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644321:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491688320:12345-0@lo:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644326:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853226.644345:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687808 00000100:00100000:0.0:1787853226.644348:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687808 00000100:00100000:0.0:1787853226.644369:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853226.644376:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491687808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644400:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491687808:12345-0@lo:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644405:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853226.644435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491687424:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.644475:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491687936:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.644509:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491688448:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.644545:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853226.644550:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491687552:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.644584:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491688064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644601:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853226.644629:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687936 00000100:00100000:0.0:1787853226.644633:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687936 00000100:00100000:0.0:1787853226.644648:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688448 00000100:00100000:0.0:1787853226.644651:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688448 00000100:00100000:0.0:1787853226.644665:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687552 00000100:00100000:0.0:1787853226.644667:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687552 00000100:00100000:0.0:1787853226.644676:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688064 00000100:00100000:0.0:1787853226.644678:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688064 00000100:00100000:0.0:1787853226.644691:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853226.644697:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491687936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644738:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491687936:12345-0@lo:400:kworker.0 Request processed in 41us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644745:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853226.644757:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853226.644762:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491688448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644785:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491688448:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644790:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853226.644801:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787853226.644807:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491687552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644831:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491687552:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644837:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787853226.644876:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853226.644883:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491688064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644908:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491688064:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853226.644922:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853226.644963:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491687296:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644975:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491687808:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.644984:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491688320:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.645003:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3645:1874699491687168:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.645014:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491687680:0@lo:400:kworker.0 00010000:00080000:0.0:1787853226.645025:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbe6ab9e00 x1874699491688192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853226.645034:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491688192:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.645072:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491687552:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.645081:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491688064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853226.645089:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491687936:0@lo:400:kworker.0 00010000:00080000:0.0:1787853226.645098:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbe6ab9680 x1874699491688448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853226.645106:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491688448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853226.645412:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687424 00000100:00100000:3.0:1787853226.645417:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687424 00000100:00100000:3.0:1787853226.645459:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853226.645466:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6abb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491687424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853226.645511:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6abb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491687424:12345-0@lo:400:kworker.0 Request processed in 46us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853226.645517:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853226.645566:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac2f25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853226.645593:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491687424:0@lo:400:kworker.0 00000100:00080000:1.0:1787853226.645694:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853226.645699:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853226.645701:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853226.645712:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491687040 00000100:00100000:1.0:1787853226.645716:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491687040 00000100:00100000:1.0:1787853226.645763:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787853226.645770:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491687040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787853226.645784:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853226.645822:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491687040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853226.645828:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787853226.645911:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853226.645945:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491687040:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787853226.961262:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853227.984144:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853228.558087:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853228.558136:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853228.558182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853228.558232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853228.558244:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472742912 00000100:00100000:3.0:1787853228.558254:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472742912 00000100:00100000:1.0:1787853228.558302:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743296 00000100:00100000:1.0:1787853228.558307:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743296 00000100:00100000:3.0:1787853228.558322:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:3.0:1787853228.558332:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2398:x1874699472742912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853228.558355:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1787853228.558363:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2398:x1874699472743296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853228.558489:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2398:x1874699472742912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 158us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.558511:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:0.0:1787853228.558517:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743040 00000100:00100000:0.0:1787853228.558521:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743040 00000100:00100000:0.0:1787853228.558556:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743168 00000100:00100000:0.0:1787853228.558559:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743168 00000100:00100000:0.0:1787853228.558581:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1787853228.558596:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+14:2398:x1874699472743040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:2.0:1787853228.559689:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787853228.559695:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853228.559698:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853228.559719:0:20276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1787853228.559745:0:20276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47986e87-8752-448c-a7be-86cefabcf156+5:2398:x1874699472743168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853228.561647:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2398:x1874699472743296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 3272us (3497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.561665:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1787853228.562289:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3e8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+14:2398:x1874699472743040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 3689us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853228.562300:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:2.0:1787853228.568742:0:20276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47986e87-8752-448c-a7be-86cefabcf156+5:2398:x1874699472743168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 8982us (10487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853228.568769:0:20276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1787853228.578442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853228.579801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853228.581414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853228.581456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853228.582222:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743424 00000100:00100000:2.0:1787853228.582233:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743424 00000100:00100000:2.0:1787853228.582292:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743808 00000100:00100000:2.0:1787853228.582296:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743808 00000100:00100000:2.0:1787853228.582324:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1787853228.582334:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47986e87-8752-448c-a7be-86cefabcf156+5:2395:x1874699472743424:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1787853228.582368:0:18645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2997 00000100:00080000:2.0:1787853228.582385:0:18645:0:(import.c:65:import_set_state_nolock()) ffff8cfac3a38000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853228.582430:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787853228.582608:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47986e87-8752-448c-a7be-86cefabcf156+2:2395:x1874699472743424:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 275us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853228.582617:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1787853228.582635:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1787853228.582642:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2395:x1874699472743808:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1787853228.582655:0:18645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af29cf 00000100:00080000:2.0:1787853228.582677:0:18645:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6f8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853228.582703:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787853228.583195:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+2:2395:x1874699472743808:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 552us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853228.583203:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:2.0:1787853228.583224:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853228.583232:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853228.583236:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853228.583692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853228.583730:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743936 00000100:00100000:3.0:1787853228.583736:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743936 00000100:00100000:3.0:1787853228.583788:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1787853228.583796:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2395:x1874699472743936:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1787853228.583823:0:18645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af29d6 00000100:00080000:3.0:1787853228.583830:0:18645:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6fb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787853228.583882:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787853228.583987:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+2:2395:x1874699472743936:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 192us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.583995:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00010000:00010000:3.0:1787853228.584009:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853228.584074:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853228.584712:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853228.590265:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743552 00000100:00100000:0.0:1787853228.590282:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743552 00000100:00100000:0.0:1787853228.590396:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472743680 00000100:00100000:0.0:1787853228.590400:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472743680 00000100:00100000:3.0:1787853228.590445:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1787853228.590458:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2398:x1874699472743552:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853228.590562:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2398:x1874699472743552:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 107us (12130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.590570:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00080000:2.0:1787853228.591680:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787853228.591686:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853228.592123:0:20276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:3.0:1787853228.592135:0:20276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2f24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2398:x1874699472743680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853228.592228:0:20276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2f24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2398:x1874699472743680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 97us (12435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.592236:0:20276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1787853228.688327:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853228.688357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac44c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491688576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853228.688436:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853228.688717:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688576 00000100:00100000:1.0:1787853228.688737:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688576 00000100:00100000:1.0:1787853228.688809:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853228.688820:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491688576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787853228.688872:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787853228.688922:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491688576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853228.688930:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787853228.689123:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853228.690776:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac44c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491688576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853228.690949:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491688704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853228.691027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853228.691179:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688704 00000100:00100000:3.0:1787853228.691187:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688704 00000100:00100000:3.0:1787853228.691254:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853228.691263:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491688704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853228.691282:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787853228.691324:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491688704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853228.691332:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787853228.691648:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853228.691676:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491688704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853229.008092:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853229.200362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853229.200453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853229.200636:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688832 00000100:00100000:0.0:1787853229.200647:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688832 00000100:00100000:0.0:1787853229.200708:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853229.200717:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491688832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787853229.200752:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787853229.200819:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491688832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853229.200828:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853229.201276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491688832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853229.201826:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853229.201857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491688960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853229.201906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853229.202348:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491688960 00000100:00100000:1.0:1787853229.202355:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491688960 00000100:00100000:1.0:1787853229.202404:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787853229.202411:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491688960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787853229.202552:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853229.202606:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491688960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853229.202614:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787853229.202752:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491688960:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787853229.460641:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787853229.460652:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853229.460689:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787853229.460698:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787853230.033391:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853230.277163:0:20512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 13:53:49 (1787853229) 00000001:00080000:1.0:1787853230.741527:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1787853230.741554:0:17119:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1787853230.741597:0:17179:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1787853230.741609:0:17179:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1787853231.058065:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853231.760330:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491689088:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760452:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491689600:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760500:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491690112:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491690624:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760594:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787853231.760600:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491689472:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491689984:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760729:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491690496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760774:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491689216:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760812:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491689728:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760868:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491690240:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760914:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787853231.760921:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491689344:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.760968:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491689856:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.760988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.761003:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491690368:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853231.761050:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689088 00000100:00100000:1.0:1787853231.761058:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689088 00000100:00100000:1.0:1787853231.761105:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787853231.761114:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3644:x1874699491689088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761164:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3644:x1874699491689088:12345-0@lo:400:kworker.0 Request processed in 51us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761171:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787853231.761203:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689600 00000100:00100000:1.0:1787853231.761207:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689600 00000100:00100000:1.0:1787853231.761227:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690112 00000100:00100000:1.0:1787853231.761229:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690112 00000100:00100000:1.0:1787853231.761239:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690624 00000100:00100000:1.0:1787853231.761241:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690624 00000100:00100000:1.0:1787853231.761264:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690496 00000100:00100000:1.0:1787853231.761266:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690496 00000100:00100000:1.0:1787853231.761275:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690240 00000100:00100000:1.0:1787853231.761277:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690240 00000100:00100000:1.0:1787853231.761288:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690368 00000100:00100000:1.0:1787853231.761290:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690368 00000100:00100000:1.0:1787853231.761302:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853231.761308:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491689600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761339:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491689600:12345-0@lo:400:kworker.0 Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761355:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853231.761368:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853231.761375:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe60530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491690112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761417:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe60530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491690112:12345-0@lo:400:kworker.0 Request processed in 42us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761423:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853231.761436:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787853231.761441:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6051a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491690624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761467:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6051a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491690624:12345-0@lo:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761472:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787853231.761482:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787853231.761488:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6051e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491690496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761516:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6051e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491690496:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761521:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787853231.761533:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787853231.761539:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6050b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491690240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761571:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6050b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491690240:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761577:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787853231.761589:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787853231.761595:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6050780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761620:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6050780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491690368:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761633:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787853231.761667:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689472 00000100:00100000:1.0:1787853231.761671:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689472 00000100:00100000:1.0:1787853231.761691:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689984 00000100:00100000:1.0:1787853231.761694:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689984 00000100:00100000:1.0:1787853231.761705:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689344 00000100:00100000:1.0:1787853231.761707:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689344 00000100:00100000:1.0:1787853231.761717:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689856 00000100:00100000:1.0:1787853231.761720:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689856 00000100:00100000:1.0:1787853231.761730:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853231.761736:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe60512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491689472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761766:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe60512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491689472:12345-0@lo:400:kworker.0 Request processed in 30us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761772:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853231.761783:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853231.761789:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6053c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491689984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761815:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6053c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491689984:12345-0@lo:400:kworker.0 Request processed in 27us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761821:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853231.761831:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853231.761836:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe60503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491689344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761888:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe60503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491689344:12345-0@lo:400:kworker.0 Request processed in 52us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761894:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853231.761917:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853231.761923:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe60521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491689856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.761955:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe60521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491689856:12345-0@lo:400:kworker.0 Request processed in 33us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.761962:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853231.761983:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689216 00000100:00100000:1.0:1787853231.761987:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689216 00000100:00100000:1.0:1787853231.762009:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491689728 00000100:00100000:1.0:1787853231.762012:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491689728 00000100:00100000:1.0:1787853231.762023:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787853231.762029:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6050f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491689216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762058:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6050f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491689216:12345-0@lo:400:kworker.0 Request processed in 29us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.762064:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787853231.762074:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787853231.762079:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6051680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491689728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762104:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6051680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491689728:12345-0@lo:400:kworker.0 Request processed in 25us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853231.762110:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787853231.762135:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853231.762140:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853231.762142:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853231.762145:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853231.762178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491689344:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762188:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491689856:0@lo:400:kworker.0 00010000:00080000:1.0:1787853231.762200:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfbd921c0 x1874699491690368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853231.762210:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491690368:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762227:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491689216:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491689728:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762246:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491690240:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762283:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491689472:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491689984:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762301:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491690496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762310:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491689088:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491689600:0@lo:400:kworker.0 00000100:00100000:1.0:1787853231.762328:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491690112:0@lo:400:kworker.0 00010000:00080000:1.0:1787853231.762338:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfbd90000 x1874699491690624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853231.762347:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491690624:0@lo:400:kworker.0 00000100:00100000:3.0:1787853231.764435:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853231.764460:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491690752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853231.765249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853231.765302:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6052580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491690880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853231.765333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853231.765368:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690752 00000100:00100000:3.0:1787853231.765375:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690752 00000100:00100000:3.0:1787853231.765410:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491690880 00000100:00100000:3.0:1787853231.765412:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491690880 00000100:00100000:3.0:1787853231.765428:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853231.765449:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491690752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853231.765478:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787853231.765598:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491690752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853231.765606:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853231.765623:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853231.765630:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491690880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787853231.765641:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787853231.765666:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491690880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853231.765672:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853231.765709:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6052580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491690880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853231.765721:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491690752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853232.080081:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853233.104810:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853233.661677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853233.661717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853233.661744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853233.661778:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853233.661798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853233.661819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853233.661960:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744064 00000100:00100000:3.0:1787853233.661970:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744064 00000100:00100000:3.0:1787853233.662025:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1787853233.662034:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2396:x1874699472744064:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853233.662111:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2396:x1874699472744064:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.662119:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1787853233.662150:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744320 00000100:00100000:3.0:1787853233.662154:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744320 00000100:00100000:3.0:1787853233.662183:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744576 00000100:00100000:3.0:1787853233.662186:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744576 00000100:00100000:3.0:1787853233.662198:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744192 00000100:00100000:3.0:1787853233.662200:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744192 00000100:00100000:3.0:1787853233.662222:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744704 00000100:00100000:3.0:1787853233.662224:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744704 00000100:00100000:3.0:1787853233.662240:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:3.0:1787853233.662246:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+5:2396:x1874699472744320:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853233.662277:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+5:2396:x1874699472744320:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.662284:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:3.0:1787853233.662295:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1787853233.662302:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2396:x1874699472744576:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853233.662323:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2396:x1874699472744576:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.662329:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1787853233.662339:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1787853233.662345:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+13:2396:x1874699472744192:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853233.662369:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+13:2396:x1874699472744192:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.662375:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1787853233.662386:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1787853233.662392:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2396:x1874699472744704:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853233.662414:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2396:x1874699472744704:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.662421:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:1.0:1787853233.662685:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744448 00000100:00100000:1.0:1787853233.662690:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744448 00000100:00100000:1.0:1787853233.662729:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1787853233.662737:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47986e87-8752-448c-a7be-86cefabcf156+5:2396:x1874699472744448:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853233.662770:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47986e87-8752-448c-a7be-86cefabcf156+5:2396:x1874699472744448:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853233.662777:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00080000:1.0:1787853233.662795:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853233.662807:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853233.662809:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853233.808381:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6053840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491691136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853233.808382:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491691008:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787853233.810372:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000020:00000080:3.0:1787853233.810380:0:19458:0:(genops.c:885:class_export_put()) final put ffff8cfbde6f9000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000001:00100000:3.0:1787853233.810405:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:3.0:1787853233.810408:0:19458:0:(genops.c:885:class_export_put()) final put ffff8cfac3a3e000/47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:3.0:1787853233.810432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6f9000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 for lustre-OST0001 00000020:00000080:3.0:1787853233.810471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3a3e000/47986e87-8752-448c-a7be-86cefabcf156 for lustre-OST0001 00000020:00000080:3.0:1787853233.810485:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6fb000 for lustre-OST0001 00000020:00000080:3.0:1787853233.810490:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3a38000 for lustre-OST0001 00000001:00100000:3.0:1787853233.812929:0:18641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000020:00000080:3.0:1787853233.812940:0:18641:0:(genops.c:885:class_export_put()) final put ffff8cfbde6fe000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000020:00000080:2.0:1787853233.813156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6fe000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 for lustre-OST0000 00000020:00000080:2.0:1787853233.813206:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6f8800 for lustre-OST0000 00000100:00100000:1.0:1787853233.813504:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853233.813622:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691136 00000100:00100000:3.0:1787853233.813631:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691136 00000100:00100000:3.0:1787853233.813710:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853233.813721:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491691136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787853233.813752:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787853233.813800:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491691136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.813808:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787853233.814042:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853233.814151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6053840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491691136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853233.816370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853233.816753:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691008 00000100:00100000:3.0:1787853233.816762:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691008 00000100:00100000:3.0:1787853233.816830:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787853233.816862:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491691008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853233.816901:0:18648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787853233.817187:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491691008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 347us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853233.817196:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787853233.817282:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491691008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853233.818059:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853234.128151:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853234.256750:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787853234.320243:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853234.320265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491691264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853234.320336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853234.320444:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691264 00000100:00100000:1.0:1787853234.320452:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691264 00000100:00100000:1.0:1787853234.320510:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853234.320518:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491691264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853234.320553:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787853234.320610:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491691264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853234.320617:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853234.320707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491691264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853234.321019:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6053840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491691392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787853234.321048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853234.321231:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691392 00000100:00100000:1.0:1787853234.321236:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691392 00000100:00100000:1.0:1787853234.321274:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853234.321281:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491691392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787853234.321300:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853234.321342:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491691392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853234.321349:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787853234.321417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6053840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491691392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853235.092326:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853235.092506:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472744960 00000100:00100000:0.0:1787853235.092516:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472744960 00000100:00100000:0.0:1787853235.092594:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1787853235.092604:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd29ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47986e87-8752-448c-a7be-86cefabcf156+13:16342:x1874699472744960:12345-192.168.201.29@tcp:35:umount.0 00000001:00080000:0.0:1787853235.092970:0:17142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1787853235.093100:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd29ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47986e87-8752-448c-a7be-86cefabcf156+15:16342:x1874699472744960:12345-192.168.201.29@tcp:35:umount.0 Request processed in 497us (783us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1787853235.093108:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000020:00080000:0.0:1787853235.093114:0:17142:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1787853235.093356:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853235.113661:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853235.113728:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853235.113891:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472745088 00000100:00100000:3.0:1787853235.113912:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472745088 00000100:00100000:3.0:1787853235.113984:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472745216 00000100:00100000:3.0:1787853235.113988:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472745216 00000100:00100000:3.0:1787853235.114021:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1787853235.114031:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+14:2396:x1874699472745088:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853235.114058:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853235.114079:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfccca600/0xe2bf4b958af296d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125834 expref: 14 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853235.114096:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853235.114152:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+13:2396:x1874699472745088:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 122us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853235.114160:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1787853235.114177:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1787853235.114183:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4454050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+12:2396:x1874699472745216:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853235.114192:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853235.114202:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcccb000/0xe2bf4b958af2974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125865 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853235.114211:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853235.114228:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4454050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+11:2396:x1874699472745216:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853235.114235:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1787853235.124348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853235.124564:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472745344 00000100:00100000:1.0:1787853235.124586:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472745344 00000100:00100000:1.0:1787853235.124659:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1787853235.124669:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+11:2399:x1874699472745344:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853235.124684:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853235.124704:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240c00/0xe2bf4b958af29f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c8412591b expref: 11 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853235.124721:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853235.124782:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:822aa76a-fee9-4c6d-8d66-e960ac059f95+10:2399:x1874699472745344:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 114us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853235.124790:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1787853235.142641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853235.142887:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472745472 00000100:00100000:0.0:1787853235.142906:0:18647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472745472 00000100:00100000:0.0:1787853235.142978:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1787853235.142988:0:18647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47986e87-8752-448c-a7be-86cefabcf156+5:2395:x1874699472745472:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:0.0:1787853235.143029:0:18647:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2990 00000100:00080000:0.0:1787853235.143040:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfac440e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853235.143101:0:18647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787853235.143267:0:18647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47986e87-8752-448c-a7be-86cefabcf156+2:2395:x1874699472745472:12345-192.168.201.29@tcp:9:umount.0 Request processed in 279us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853235.143275:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00080000:1.0:1787853235.143602:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853235.143873:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853235.157221:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853235.157487:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472746368 00000100:00100000:1.0:1787853235.157497:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472746368 00000100:00100000:1.0:1787853235.157558:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:1.0:1787853235.157568:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+15:2395:x1874699472746368:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:1.0:1787853235.157601:0:17141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2982 00000020:00010000:1.0:1787853235.157626:0:17141:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfbc3034800: total 0 00000100:00080000:1.0:1787853235.157631:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c5c800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787853235.158249:0:17128:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfbc3034800: total 0 00010000:00010000:0.0:1787853235.158254:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853235.158305:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfbc3034800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787853235.158339:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfbfb601f00) 00010000:00010000:0.0:1787853235.158344:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853235.158353:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794c00/0xe2bf4b958af2bab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c8412598b expref: 14 pid: 20276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158374:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfbfb601f00) 00010000:00010000:0.0:1787853235.158377:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853235.158380:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3e00/0xe2bf4b958af2c92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259d8 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158394:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:0.0:1787853235.158396:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853235.158400:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2800/0xe2bf4b958af2a69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125929 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158418:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9800) 00010000:00010000:0.0:1787853235.158421:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853235.158425:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af2aa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125937 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158438:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfac2ca7e00) 00010000:00010000:0.0:1787853235.158440:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853235.158470:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241000/0xe2bf4b958af2a4d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125922 expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158489:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfbfb601200) 00010000:00010000:0.0:1787853235.158491:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853235.158495:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfccca000/0xe2bf4b958af2c37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259b5 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158510:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfbfb601e00) 00010000:00010000:0.0:1787853235.158513:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787853235.158516:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2a00/0xe2bf4b958af2b2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125961 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158529:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfbfb601f00) 00010000:00010000:0.0:1787853235.158531:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853235.158535:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240e00/0xe2bf4b958af2bdc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259a0 expref: 7 pid: 20276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853235.158547:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfbc3034800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787853235.158560:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853235.158562:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853235.158563:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787853235.163661:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1787853235.163880:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47986e87-8752-448c-a7be-86cefabcf156+5:2395:x1874699472746368:12345-192.168.201.29@tcp:39:umount.0 Request processed in 6276us (6633us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1787853235.163908:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00010000:00010000:2.0:1787853235.173181:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853235.179885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853235.180067:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472746496 00000100:00100000:1.0:1787853235.180078:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472746496 00000100:00100000:1.0:1787853235.180140:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1787853235.180151:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+5:2395:x1874699472746496:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:1.0:1787853235.180208:0:17140:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2989 00000100:00080000:1.0:1787853235.180228:0:17140:0:(import.c:65:import_set_state_nolock()) ffff8cfac2538000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853235.180261:0:17140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787853235.180333:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853235.180494:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47986e87-8752-448c-a7be-86cefabcf156+3:2395:x1874699472746496:12345-192.168.201.29@tcp:39:umount.0 Request processed in 345us (664us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787853235.180502:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00080000:2.0:1787853235.180887:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787853236.176073:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853236.880741:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853236.880763:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6052d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491691648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787853236.880880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853236.880959:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691648 00000100:00100000:1.0:1787853236.880966:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691648 00000100:00100000:1.0:1787853236.881019:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853236.881030:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6052940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491691648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787853236.881057:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853236.881100:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6052940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491691648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853236.881120:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787853236.881142:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853236.881180:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6052d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491691648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853236.881745:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491691776:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.881794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.881836:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491692288:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.881874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.881889:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491692800:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.881911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.881927:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787853236.881933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491691904:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.881956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.881971:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491692416:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.881990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.882005:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491692928:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.882023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853236.882044:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691904 00000100:00100000:3.0:1787853236.882049:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691904 00000100:00100000:3.0:1787853236.882077:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692416 00000100:00100000:3.0:1787853236.882080:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692416 00000100:00100000:3.0:1787853236.882098:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853236.882325:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691776 00000100:00100000:2.0:1787853236.882330:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691776 00000100:00100000:2.0:1787853236.882356:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692288 00000100:00100000:2.0:1787853236.882359:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692288 00000100:00100000:2.0:1787853236.882371:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853236.882377:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491691776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882424:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491691776:12345-0@lo:400:kworker.0 Request processed in 47us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.882431:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853236.882445:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787853236.882451:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491692288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882475:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491692288:12345-0@lo:400:kworker.0 Request processed in 24us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.882481:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787853236.882496:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692800 00000100:00100000:2.0:1787853236.882499:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692800 00000100:00100000:2.0:1787853236.882519:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692928 00000100:00100000:2.0:1787853236.882522:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692928 00000100:00100000:2.0:1787853236.882537:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787853236.882543:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491692800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882583:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491692800:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.882601:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787853236.882614:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787853236.882619:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491692928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882645:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491692928:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.882651:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787853236.882683:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491692928:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882692:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491691776:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882700:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491692288:0@lo:400:kworker.0 00010000:00080000:2.0:1787853236.882711:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac4752580 x1874699491692800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853236.882722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491692800:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882747:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491692032:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.882784:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491692544:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.882828:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491693056:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.882900:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787853236.882905:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491691520:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882929:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.882953:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491692160:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.882983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.882994:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491692672:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.883015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853236.883032:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692544 00000100:00100000:2.0:1787853236.883035:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692544 00000100:00100000:2.0:1787853236.883051:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693056 00000100:00100000:2.0:1787853236.883053:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693056 00000100:00100000:2.0:1787853236.883064:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692160 00000100:00100000:2.0:1787853236.883067:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692160 00000100:00100000:2.0:1787853236.883075:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692672 00000100:00100000:2.0:1787853236.883077:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692672 00000100:00100000:2.0:1787853236.883088:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787853236.883094:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883384:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491691904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883425:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491691904:12345-0@lo:400:kworker.0 Request processed in 1321us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853236.883433:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853236.883445:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491692032 00000100:00100000:3.0:1787853236.883448:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491692032 00000100:00100000:3.0:1787853236.883465:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853236.883470:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491692416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883496:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491692416:12345-0@lo:400:kworker.0 Request processed in 25us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853236.883508:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853236.883519:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853236.883525:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491692032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883555:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491692032:12345-0@lo:400:kworker.0 Request processed in 31us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853236.883561:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853236.883590:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491691904:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883600:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeeb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491692416:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.883636:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491692032:0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.883761:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491692544:12345-0@lo:400:kworker.0 Request processed in 665us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.883768:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787853236.883782:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787853236.883788:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491693056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.883825:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491693056:12345-0@lo:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.883831:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787853236.883860:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787853236.883868:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2532580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491692160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.883894:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2532580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491692160:12345-0@lo:400:kworker.0 Request processed in 28us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.883900:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787853236.883910:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787853236.883924:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac25303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491692672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853236.883953:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac25303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491692672:12345-0@lo:400:kworker.0 Request processed in 30us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853236.883958:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853236.885340:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491692160:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.885355:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491692672:0@lo:400:kworker.0 00000100:00100000:3.0:1787853236.885365:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491692544:0@lo:400:kworker.0 00010000:00080000:3.0:1787853236.885379:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac4750780 x1874699491693056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853236.885390:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491693056:0@lo:400:kworker.0 00000100:00100000:1.0:1787853236.885483:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491691520 00000100:00100000:1.0:1787853236.885489:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491691520 00000100:00100000:1.0:1787853236.885539:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787853236.885547:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3643:x1874699491691520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853236.885618:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3643:x1874699491691520:12345-0@lo:400:kworker.0 Request processed in 72us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853236.885626:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787853236.885668:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853236.885673:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853236.885677:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853236.885679:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853236.885921:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491693184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853236.885959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853236.885998:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693184 00000100:00100000:0.0:1787853236.886002:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693184 00000100:00100000:0.0:1787853236.886029:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853236.886036:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491693184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853236.886060:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787853236.886097:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491693184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853236.886116:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853236.886148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491693184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853236.887424:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491691520:0@lo:400:kworker.0 00000100:00100000:3.0:1787853237.002000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853237.002063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853237.002096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853237.002241:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472746624 00000100:00100000:0.0:1787853237.002250:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472746624 00000100:00100000:0.0:1787853237.002307:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472746880 00000100:00100000:0.0:1787853237.002310:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472746880 00000100:00100000:0.0:1787853237.002322:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472746752 00000100:00100000:0.0:1787853237.002324:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472746752 00000100:00100000:0.0:1787853237.002338:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1787853237.002347:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:822aa76a-fee9-4c6d-8d66-e960ac059f95+12:2396:x1874699472746624:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853237.002361:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853237.002379:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbff4aa400/0xe2bf4b958af29ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841258a4 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.002396:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853237.002511:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1787853237.002520:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:822aa76a-fee9-4c6d-8d66-e960ac059f95+11:2396:x1874699472746880:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853237.002528:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853237.002537:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240800/0xe2bf4b958af29f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125914 expref: 11 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853237.002546:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853237.002619:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:822aa76a-fee9-4c6d-8d66-e960ac059f95+10:2396:x1874699472746624:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 267us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853237.002628:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1787853237.002646:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1787853237.002652:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:822aa76a-fee9-4c6d-8d66-e960ac059f95+9:2396:x1874699472746752:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853237.002659:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853237.002668:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc241c00/0xe2bf4b958af29b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841258d5 expref: 9 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.002694:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853237.005696:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:822aa76a-fee9-4c6d-8d66-e960ac059f95+8:2396:x1874699472746880:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3164us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853237.005710:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1787853237.005960:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:822aa76a-fee9-4c6d-8d66-e960ac059f95+7:2396:x1874699472746752:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3305us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853237.005968:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1787853237.012524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853237.012629:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747136 00000100:00100000:2.0:1787853237.012638:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747136 00000100:00100000:2.0:1787853237.012704:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1787853237.012713:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+6:2395:x1874699472747136:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:2.0:1787853237.012758:0:17138:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af29c1 00000020:00010000:2.0:1787853237.012766:0:17138:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfbde6fd000: total 0 00000100:00080000:2.0:1787853237.012770:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6f8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853237.012795:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1787853237.012961:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2395:x1874699472747136:12345-192.168.201.29@tcp:39:umount.0 Request processed in 249us (446us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1787853237.012969:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000020:00010000:0.0:1787853237.013300:0:17128:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfbde6fd000: total 0 00010000:00010000:0.0:1787853237.013347:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfbde6fd000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787853237.013379:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9800) 00010000:00010000:0.0:1787853237.013383:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853237.013391:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccae00/0xe2bf4b958af2ab6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c8412593e expref: 4 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.013412:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfbde6fd000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787853237.013421:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.013423:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.013425:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853237.013820:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853237.029584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853237.029797:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747264 00000100:00100000:1.0:1787853237.029807:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747264 00000100:00100000:1.0:1787853237.029949:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1787853237.029961:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+5:2395:x1874699472747264:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:1.0:1787853237.030012:0:17141:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af29c8 00000100:00080000:1.0:1787853237.030023:0:17141:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853237.030096:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1787853237.030250:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c64c8a1-ab15-472b-95ce-f73d4586a8c3+3:2395:x1874699472747264:12345-192.168.201.29@tcp:39:umount.0 Request processed in 291us (676us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787853237.030258:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00010000:00010000:3.0:1787853237.031108:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853237.031558:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787853237.088987:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853237.089241:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747520 00000100:00100000:1.0:1787853237.089252:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747520 00000100:00100000:1.0:1787853237.089312:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:1.0:1787853237.089323:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:822aa76a-fee9-4c6d-8d66-e960ac059f95+7:2395:x1874699472747520:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:1.0:1787853237.089381:0:17134:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af295f 00000020:00010000:1.0:1787853237.089389:0:17134:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfac459f800: total 0 00000100:00080000:1.0:1787853237.089394:0:17134:0:(import.c:65:import_set_state_nolock()) ffff8cfac3cb9800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787853237.089466:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:822aa76a-fee9-4c6d-8d66-e960ac059f95+3:2395:x1874699472747520:12345-192.168.201.29@tcp:251:umount.0 Request processed in 144us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853237.089475:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000020:00010000:0.0:1787853237.090398:0:17128:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfac459f800: total 0 00010000:00010000:0.0:1787853237.090405:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.090467:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfac459f800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787853237.090503:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbff4abe00/0xe2bf4b958af2966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c8412582d expref: 2 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853237.090521:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfac459f800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787853237.090531:0:17128:0:(genops.c:885:class_export_put()) final put ffff8cfac459f800/822aa76a-fee9-4c6d-8d66-e960ac059f95 00010000:00010000:0.0:1787853237.090550:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.090552:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853237.090554:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787853237.090783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac459f800/822aa76a-fee9-4c6d-8d66-e960ac059f95 for MGS 00000020:00000080:3.0:1787853237.090887:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3cb9800 for MGS 00010000:00010000:3.0:1787853237.201302:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853238.227237:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853238.927970:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853238.928008:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491693312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853238.928086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853238.928137:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693312 00000100:00100000:0.0:1787853238.928145:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693312 00000100:00100000:0.0:1787853238.928202:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787853238.928211:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491693312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853238.928240:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787853238.928283:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491693312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853238.928290:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787853238.928309:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853238.928344:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491693312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853238.932927:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853238.932950:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac2530b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491693440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853238.933026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853238.933087:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693440 00000100:00100000:2.0:1787853238.933103:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693440 00000100:00100000:2.0:1787853238.933157:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853238.933166:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2531a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491693440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787853238.933190:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853238.933233:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2531a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491693440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853238.933240:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787853238.933274:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853238.933309:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac2530b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491693440:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1787853239.140225:0:20707:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787853239.152073:0:20707:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787853239.152129:0:20707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.152144:0:20707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.152151:0:20707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.152158:0:20707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.152181:0:20707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787853239.152186:0:20707:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787853239.152211:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853239.152228:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787853239.152233:0:20707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787853239.152262:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfbe6bb0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787853239.152346:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853239.152353:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152360:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794800 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853239.152364:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152372:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853239.152390:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853239.152408:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853239.152410:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787853239.152413:0:17127:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787853239.152439:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152445:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853239.152471:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152477:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af2522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2529 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152489:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853239.152491:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853239.152493:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853239.152500:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853239.152519:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac2530b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491693696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853239.152598:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853239.152657:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693696 00000100:00100000:2.0:1787853239.152665:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693696 00000100:00100000:2.0:1787853239.152713:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853239.152723:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2532d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5f0fee8-afcd-4dd4-be87-985382cb1f01+24:3644:x1874699491693696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853239.152736:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853239.152750:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd94800/0xe2bf4b958af2529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2522 expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.152762:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853239.152812:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2532d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5f0fee8-afcd-4dd4-be87-985382cb1f01+23:3644:x1874699491693696:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853239.152818:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853239.152883:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac2530b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491693696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853239.154567:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491693568:0@lo:39:umount.0 00000100:00100000:2.0:1787853239.154622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853239.155563:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693568 00000100:00100000:0.0:1787853239.155573:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693568 00000100:00100000:0.0:1787853239.155631:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787853239.155641:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac2530b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874699491693568:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787853239.155671:0:17138:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2553 00000100:00080000:0.0:1787853239.155682:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8cfbd8e2f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787853239.155762:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac2530b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1874699491693568:12345-0@lo:39:umount.0 Request processed in 122us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853239.155769:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1787853239.155791:0:17138:0:(genops.c:885:class_export_put()) final put ffff8cfbfcd88800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787853239.155813:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787853239.155822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfcd88800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787853239.155894:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbd8e2f000 for lustre-MDT0000 00000100:00080000:2.0:1787853239.156252:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbe6bb0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787853239.156269:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491693568:0@lo:39:umount.0 00000100:00080000:0.0:1787853239.157102:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853239.157107:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787853239.157112:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787853239.162644:0:20707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162665:0:20707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162672:0:20707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162679:0:20707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162710:0:20707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853239.162716:0:20707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162722:0:20707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162727:0:20707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162732:0:20707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162744:0:20707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787853239.162758:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853239.162764:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162770:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbff4aa600 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853239.162783:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162792:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853239.162798:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853239.162803:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853239.162811:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787853239.162881:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162888:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853239.162909:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.162915:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aa600/0xe2bf4b958af2473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af247a expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.163119:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787853239.163152:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491693824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853239.163225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853239.164256:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693824 00000100:00100000:2.0:1787853239.164265:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693824 00000100:00100000:2.0:1787853239.164324:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853239.164334:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+23:3644:x1874699491693824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853239.164348:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853239.164366:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af247a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2473 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.164475:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.164477:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.164479:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.164504:0:20707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.164513:0:20707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.164520:0:20707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.164525:0:20707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165159:0:20707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853239.165172:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853239.165178:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165202:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4795000 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853239.165206:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165216:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853239.165223:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853239.165229:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787853239.165233:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787853239.165235:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787853239.165264:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165270:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853239.165294:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165302:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4795000/0xe2bf4b958af2a2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a31 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165314:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.165315:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.165317:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853239.165324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853239.165339:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491693952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853239.165412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853239.165471:0:20707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165479:0:20707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165485:0:20707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165492:0:20707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165504:0:20707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787853239.165507:0:20707:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787853239.165510:0:20707:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787853239.165549:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853239.165554:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165560:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbff4aaa00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853239.165563:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165570:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853239.165576:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853239.165581:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853239.165583:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787853239.165591:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787853239.165620:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165626:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853239.165636:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165642:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aaa00/0xe2bf4b958af2465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af246c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.165651:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.165652:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.165654:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853239.165664:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491694080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853239.165687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787853239.165717:0:20707:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787853239.165721:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787853239.165725:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853239.165731:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787853239.165736:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfac3c5d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853239.165741:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfac3cbc800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853239.165745:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfac443e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853239.165750:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfbc3751000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853239.165756:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8cfbde6fd000 7c64c8a1-ab15-472b-95ce-f73d4586a8c3 192.168.201.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787853239.165761:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8cfbc3034800 47986e87-8752-448c-a7be-86cefabcf156 192.168.201.29@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787853239.165766:0:20707:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cfbfdc819d0) has exports, disconnecting them 00000020:00080000:0.0:1787853239.165770:0:20707:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfac3c5d000), last request at 1787853236 00000020:00000080:0.0:1787853239.165795:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2855 00000100:00080000:0.0:1787853239.165810:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c59800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787853239.165871:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787853239.165883:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac3c5d000): rc 0 00000020:00000080:0.0:1787853239.165885:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac3c5d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787853239.165894:0:20707:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfac3cbc800), last request at 1787853236 00000020:00000080:0.0:1787853239.165897:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af26f0 00000100:00080000:0.0:1787853239.165904:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfac3cbf000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787853239.165916:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c5d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1787853239.166113:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853239.166157:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+22:3644:x1874699491693824:12345-0@lo:103:ldlm_bl.0 Request processed in 1824us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853239.166167:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853239.166189:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491693952 00000100:00100000:2.0:1787853239.166194:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491693952 00000100:00100000:2.0:1787853239.166218:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694080 00000100:00100000:2.0:1787853239.166220:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694080 00000100:00100000:2.0:1787853239.166244:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853239.166250:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+23:3646:x1874699491693952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853239.166261:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853239.166273:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff3800/0xe2bf4b958af2a31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2a2a expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.166283:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853239.166312:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+22:3646:x1874699491693952:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853239.166318:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853239.166355:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853239.166361:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+21:3646:x1874699491694080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853239.166368:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853239.166376:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af246c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2465 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853239.166384:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853239.166408:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+20:3646:x1874699491694080:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853239.166414:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853239.166457:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491694080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853239.166465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491693952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853239.166489:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3644:1874699491693824:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787853239.170443:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3c59800 for lustre-MDT0000 00010000:00010000:2.0:1787853239.170490:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853239.170767:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac3cbc800): rc 0 00000020:00000080:2.0:1787853239.170771:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac3cbc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787853239.170818:0:20707:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfac443e000), last request at 1787853162 00000020:00000080:2.0:1787853239.171154:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2641 00000100:00080000:2.0:1787853239.171165:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfac443a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787853239.171189:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853239.171199:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac443e000): rc 0 00000020:00000080:2.0:1787853239.171201:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac443e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787853239.171206:0:20707:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfbc3751000), last request at 1787853162 00000020:00000080:2.0:1787853239.171209:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25d8 00000100:00080000:2.0:1787853239.171213:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f70000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787853239.171223:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787853239.171230:0:20707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00000080:0.0:1787853239.171698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3cbc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787853239.171746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac443e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787853239.171766:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3cbf000 for lustre-MDT0000 00000020:00000080:0.0:1787853239.171770:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac443a000 for lustre-MDT0000 00010000:00010000:0.0:1787853239.172744:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.172755:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.172766:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbff4ab400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853239.172769:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.172790:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853239.172797:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853239.172802:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853239.172817:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787853239.172820:0:17127:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1787853239.173204:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfbc3751000): rc 0 00000004:00000080:2.0:1787853239.173212:0:20707:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9b8f07adfae0 00000100:00080000:2.0:1787853239.173230:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787853239.173234:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787853239.174347:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.174359:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853239.175104:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.175115:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbff4ab400/0xe2bf4b958af2886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af288d expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853239.175133:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.175135:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853239.175138:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853239.175161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491694208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853239.175230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853239.175759:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853239.175762:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853239.175794:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694208 00000100:00100000:1.0:1787853239.175814:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694208 00000100:00100000:1.0:1787853239.176784:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787853239.176796:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+20:3643:x1874699491694208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853239.176809:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853239.176838:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af288d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2886 expref: 20 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853239.177466:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853239.177527:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5f0fee8-afcd-4dd4-be87-985382cb1f01+19:3643:x1874699491694208:12345-0@lo:103:ldlm_bl.0 Request processed in 733us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853239.177544:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853239.178189:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491694208:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787853239.180768:0:20707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787853239.180810:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b85000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787853239.181335:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694336:0@lo:39:umount.0 00000100:00100000:0.0:1787853239.181410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853239.181484:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694336 00000100:00100000:1.0:1787853239.181492:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694336 00000100:00100000:1.0:1787853239.181557:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853239.181567:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874699491694336:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787853239.181711:0:17881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af266b 00000100:00080000:1.0:1787853239.181720:0:17881:0:(import.c:65:import_set_state_nolock()) ffff8cfbe6aaa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853239.181743:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:2.0:1787853239.182087:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853239.182207:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787853239.182211:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1787853239.182225:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787853239.183103:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3642:x1874699491694336:12345-0@lo:39:umount.0 Request processed in 1534us (1688us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787853239.183114:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787853239.183369:0:20707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787853239.183406:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfbe02d9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787853239.183419:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787853239.183422:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1787853239.183440:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787853239.183502:0:20707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787853239.183511:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787853239.183561:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cfbfdc819d0) has no exports 00000100:00100000:0.0:1787853239.184077:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694464:0@lo:9:umount.0 00000100:00100000:0.0:1787853239.184121:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853239.184151:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694592:0@lo:9:umount.0 00000100:00100000:0.0:1787853239.184170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787853239.184203:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b85000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787853239.184209:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694336:0@lo:39:umount.0 00000100:00100000:0.0:1787853239.184233:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694464 00000100:00100000:1.0:1787853239.184466:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694592 00000100:00100000:1.0:1787853239.184472:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694592 00000100:00100000:1.0:1787853239.184529:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853239.184549:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874699491694592:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787853239.184572:0:19077:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2894 00000100:00080000:1.0:1787853239.184647:0:19077:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853239.184692:0:19077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787853239.185047:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694464 00000100:00100000:0.0:1787853239.185075:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787853239.185081:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874699491694464:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787853239.185095:0:18646:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2736 00000100:00080000:0.0:1787853239.185100:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8cfac3cbb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853239.185143:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:2.0:1787853239.185742:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853239.186726:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3642:x1874699491694464:12345-0@lo:9:umount.0 Request processed in 1640us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853239.186738:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787853239.186769:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853239.187115:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbe02d9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787853239.187128:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787853239.187130:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853239.187134:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694464:0@lo:9:umount.0 00000100:00100000:1.0:1787853239.187233:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3642:x1874699491694592:12345-0@lo:9:umount.0 Request processed in 2696us (3060us total) trans 0 rc 0/0 00000100:00080000:2.0:1787853239.187868:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787853239.187881:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787853239.187883:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853239.187887:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491694592:0@lo:9:umount.0 00000100:00100000:1.0:1787853239.188189:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787853239.188224:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853239.214417:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cfbfdc819d0) has no exports 00010000:00010000:0.0:1787853239.250187:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853239.294238:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24c0 00000020:00000080:2.0:1787853239.294256:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac27ea800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787853239.294276:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787853239.294470:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac27ea800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787853239.294570:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853239.294581:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787853239.294586:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cfac27e4d70) has no exports 00000020:00000080:3.0:1787853239.295449:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24b9 00000020:00000080:3.0:1787853239.295456:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfb6be800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787853239.295517:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853239.295525:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787853239.295528:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfb6be000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787853239.295531:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb6be000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787853239.295538:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787853239.295683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb6be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787853239.441020:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853239.441043:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491694720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853239.441119:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853239.441224:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694720 00000100:00100000:2.0:1787853239.441232:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694720 00000100:00100000:2.0:1787853239.441277:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853239.441286:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874699491694720:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787853239.441294:0:17144:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787853239.441336:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874699491694720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (217us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787853239.441342:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:02020000:0.0:1787853239.441953:0:3643:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787853239.450808:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787853239.450817:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787853239.451151:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787853239.469207:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853239.469222:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:0.0:1787853239.469232:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfbc8f8b000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853239.469269:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32c000 x1874699491694848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853239.469687:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491694848:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787853239.469755:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853239.470090:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694848 00000100:00100000:0.0:1787853239.470108:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694848 00000100:00100000:0.0:1787853239.470155:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787853239.470162:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6052d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1874699491694848:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787853239.470178:0:17881:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787853239.475403:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6052d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1874699491694848:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 5230us (5638us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853239.475420:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787853239.475637:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853239.475644:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787853239.475648:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491694848:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787853240.272083:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853240.979317:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787853240.979335:0:17872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787853240.979341:0:17872:0:(genops.c:885:class_export_put()) final put ffff8cfbe6aa9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787853240.981122:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787853240.981130:0:17119:0:(genops.c:885:class_export_put()) final put ffff8cfbc3751000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787853240.981149:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000001:00080000:3.0:1787853240.981161:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787853240.981164:0:17119:0:(genops.c:885:class_export_put()) final put ffff8cfbde6fd000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000001:00100000:3.0:1787853240.981171:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:2.0:1787853240.981178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3751000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00080000:3.0:1787853240.981179:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1787853240.981198:0:17119:0:(genops.c:885:class_export_put()) final put ffff8cfbc3034800/47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:2.0:1787853240.981240:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6fd000/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 for lustre-MDT0000 00000020:00000080:2.0:1787853240.981268:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3f70000 for lustre-MDT0000 00000020:00000080:2.0:1787853240.981273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3034800/47986e87-8752-448c-a7be-86cefabcf156 for lustre-MDT0000 00000020:00000080:2.0:1787853240.981301:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6f8000 for lustre-MDT0000 00000020:00000080:2.0:1787853240.981305:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3c5c800 for lustre-MDT0000 00000001:00100000:0.0:1787853240.983228:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000020:00000080:1.0:1787853240.983231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe6aa9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00080000:0.0:1787853240.983240:0:17872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787853240.983245:0:17872:0:(genops.c:885:class_export_put()) final put ffff8cfbde6fd800/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 00000001:00100000:0.0:1787853240.983261:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47986e87-8752-448c-a7be-86cefabcf156 00000001:00080000:0.0:1787853240.983265:0:17872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787853240.983266:0:17872:0:(genops.c:885:class_export_put()) final put ffff8cfac3c58000/47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:1.0:1787853240.983349:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbe6aaa000 for lustre-MDT0001 00000020:00000080:1.0:1787853240.983355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6fd800/7c64c8a1-ab15-472b-95ce-f73d4586a8c3 for lustre-MDT0001 00000020:00000080:1.0:1787853240.983593:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c58000/47986e87-8752-448c-a7be-86cefabcf156 for lustre-MDT0001 00000020:00000080:1.0:1787853240.983627:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6fc000 for lustre-MDT0001 00000020:00000080:1.0:1787853240.983631:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac2538000 for lustre-MDT0001 00000001:00100000:3.0:1787853240.984058:0:18641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787853240.984064:0:18641:0:(genops.c:885:class_export_put()) final put ffff8cfac3cbc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787853240.984086:0:18641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:3.0:1787853240.984089:0:18641:0:(genops.c:885:class_export_put()) final put ffff8cfac4408000/47986e87-8752-448c-a7be-86cefabcf156 00000020:00000080:2.0:1787853240.984135:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3cbc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787853240.984159:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4408000/47986e87-8752-448c-a7be-86cefabcf156 for lustre-OST0000 00000020:00000080:2.0:1787853240.984203:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3cbb800 for lustre-OST0000 00000020:00000080:2.0:1787853240.984206:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac440e000 for lustre-OST0000 00010000:00010000:1.0:1787853241.296570:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787853241.296711:0:20707:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac3e4c120 - data ffff8cfbde9825e8/ffff8cfac2c4a400 00000020:01000000:2.0:1787853241.297065:0:20707:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac4d5dc60 - data ffff8cfbde97bca8/ffff8cfbf70d9800 00000001:00000004:2.0:1787853241.303170:0:20707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1787853241.357583:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787853241.357592:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853241.357607:0:20707:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8cfac4c3e1c0 x1874699491694336/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787853249 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853241.357634:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787853241.359168:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787853241.359174:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1787853241.359197:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853241.359199:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787853241.359595:0:17163:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787853241.359600:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1787853241.359612:0:17163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787853241.360356:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787853241.360361:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787853241.360369:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853241.360371:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787853241.361406:0:17165:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787853241.361412:0:17165:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1787853241.361422:0:17165:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787853241.362686:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2488 00000020:00000080:3.0:1787853241.362698:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac3c54000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787853241.362864:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787853241.366688:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af249d 00000020:00000080:3.0:1787853241.366702:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbc3750000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787853241.366759:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787853241.366766:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853241.366775:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787853241.366779:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cfbfdc80000) has no exports 00000004:01000000:3.0:1787853241.367046:0:20707:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787853241.367055:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24ff 00000020:00000080:3.0:1787853241.367060:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfb66d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853241.372421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3750000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787853241.377917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb66d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787853241.377983:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787853241.378012:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853241.378023:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787853241.378029:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cfac3d999d0) has no exports 00000020:00000080:3.0:1787853241.378038:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24f8 00000020:00000080:3.0:1787853241.378048:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfb668000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787853241.378147:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb668000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787853241.381031:0:20707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787853241.381041:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787853241.381049:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1787853241.381104:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853241.381106:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787853241.381193:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853241.381205:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853241.381213:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24ea 00000020:00000080:3.0:1787853241.381235:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfb66c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787853241.381242:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787853241.381247:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853241.381252:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853241.381255:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cfac27e0000) has no exports 00000020:00000080:3.0:1787853241.381262:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24e3 00000020:00000080:3.0:1787853241.381266:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbe02da800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787853241.381942:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbfdcb6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787853241.381951:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfbfb66f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853241.381954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb66f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787853241.381976:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853241.382073:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb66c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787853241.382083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe02da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787853241.382300:0:20707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787853241.382304:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787853241.382306:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1787853241.382311:0:20707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853241.382312:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787853241.382343:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853241.382349:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787853241.382418:0:20707:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787853241.382424:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24d5 00000020:00000080:3.0:1787853241.382429:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbfdcb4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787853241.382433:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787853241.382436:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853241.382440:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853241.382443:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8cfac27e33a0) has no exports 00000020:00000080:3.0:1787853241.382447:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24ce 00000020:00000080:3.0:1787853241.382451:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbc8b82800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787853241.382917:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbe02d9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787853241.382924:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfbfb6bb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853241.382927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfb6bb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787853241.382932:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853241.382976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfdcb4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787853241.382981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc8b82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787853241.448472:0:20707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787853241.448483:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787853241.448488:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853241.448496:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853241.448575:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853241.448587:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853241.448622:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853241.448627:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853241.448633:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac3c54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853241.448639:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c54800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787853241.448652:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853241.448796:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24a4 00000020:00000080:0.0:1787853241.448805:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbc3756000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787853241.448811:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787853241.448815:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853241.448821:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853241.448826:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cfbe60819d0) has no exports 00000020:00000080:0.0:1787853241.448875:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853241.448879:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787853241.448885:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af24ab 00000020:00000080:0.0:1787853241.448889:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbc3750800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787853241.448912:0:20707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac4573800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787853241.448917:0:20707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac4573800 3 00000020:01000004:0.0:1787853241.448921:0:20707:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfac4573800 from lustre-MDT0000 00000020:00000080:0.0:1787853241.448946:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853241.448951:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787853241.448954:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac3c55000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787853241.448956:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c55000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787853241.449123:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbc8b85000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787853241.449130:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfbc2c40800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853241.449133:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc2c40800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787853241.449139:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853241.449219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3756000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787853241.449222:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfbc3757000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787853241.449224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3757000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787853241.449228:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787853241.449262:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3750800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787853241.449470:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787853241.449755:0:20707:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787853241.449760:0:20707:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787853241.449764:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787853241.449767:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853241.449771:0:20707:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787853241.449778:0:20707:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cfbc525b000 e5f0fee8-afcd-4dd4-be87-985382cb1f01 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787853241.449784:0:20707:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cfbfdc833a0) has exports, disconnecting them 00000020:00080000:1.0:1787853241.449787:0:20707:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cfbc525b000), last request at 1787853147 00000020:00000080:1.0:1787853241.449801:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2449 00000020:00010000:1.0:1787853241.449805:0:20707:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cfbc525b000: total 0 00000100:00080000:1.0:1787853241.449809:0:20707:0:(import.c:65:import_set_state_nolock()) ffff8cfbc5259000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787853241.449829:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfbc525b000): rc 0 00000020:00080000:1.0:1787853241.449835:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cfbfdc833a0) has no exports 00000100:00100000:1.0:1787853241.449934:0:17134:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cfbfce86e00:17134] 2 exiting: rc = 0 00000020:00010000:0.0:1787853241.450378:0:17128:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cfbc525b000: total 0 00010000:00010000:0.0:1787853241.450411:0:17128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfbc525b000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787853241.450439:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc241e00/0xe2bf4b958af2840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2839 expref: 14 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450468:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd94400/0xe2bf4b958af287f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2878 expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450481:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbff4ab000/0xe2bf4b958af26b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af26aa expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450491:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4795400/0xe2bf4b958af257d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2576 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450946:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af245e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2457 expref: 10 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450960:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcccbc00/0xe2bf4b958af256f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2568 expref: 9 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.450971:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd95e00/0xe2bf4b958af26db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af26d4 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853241.451474:0:17133:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cfac3849200:17133] 1 exiting: rc = 0 00010000:00010000:0.0:1787853241.451713:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240400/0xe2bf4b958af2a07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2a00 expref: 7 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451746:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbff4aa200/0xe2bf4b958af262c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2625 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451757:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd94e00/0xe2bf4b958af2816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af280f expref: 5 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451766:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff3a00/0xe2bf4b958af2a15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2a0e expref: 4 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451775:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794200/0xe2bf4b958af258b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2584 expref: 3 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451787:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff2200/0xe2bf4b958af2a23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2bf4b958af2a1c expref: 2 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853241.451797:0:17128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfbc525b000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787853241.451818:0:17128:0:(genops.c:885:class_export_put()) final put ffff8cfbc525b000/e5f0fee8-afcd-4dd4-be87-985382cb1f01 00010000:00010000:0.0:1787853241.451837:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853241.451839:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853241.451856:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787853241.451868:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc525b000/e5f0fee8-afcd-4dd4-be87-985382cb1f01 for MGS 00000020:00000080:0.0:1787853241.452361:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbc5259000 for MGS 00000100:00100000:3.0:1787853241.452723:0:17131:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cfbfcecc400:17131] 0 exiting: rc = 1 00000100:00100000:1.0:1787853241.452801:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452811:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452818:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452826:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452833:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452867:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452876:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452885:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452941:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452950:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452956:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452962:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452968:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452973:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452979:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452987:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452991:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.452997:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453014:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453019:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453096:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453160:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453167:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453172:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453177:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453182:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453187:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453192:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453197:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453203:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453212:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453218:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453223:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453228:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453233:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453237:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453242:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453247:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453252:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453258:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453263:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453268:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453273:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453279:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453284:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453289:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453293:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453297:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453302:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453307:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453312:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453317:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453322:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453334:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453340:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453345:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453350:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453355:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453361:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453366:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453371:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453376:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453381:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853241.453386:0:20707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787853241.455255:0:20707:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac3b30d20 - data ffff8cfbde9e6bd0/ffff8cfac2556000 00000020:01000000:1.0:1787853241.455383:0:20707:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac4d5d600 - data ffff8cfbc98f8af8/ffff8cfbe01da000 00000020:00000080:1.0:1787853241.455918:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2434 00000020:00000080:1.0:1787853241.455927:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac4572800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787853241.455942:0:20707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac4573800 from MGS, refs=2 00000020:01000004:1.0:1787853241.455946:0:20707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac4573800 2 00000020:01000004:1.0:1787853241.455949:0:20707:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfac4573800 from MGS 00000020:00000080:1.0:1787853241.455967:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853241.455973:0:20707:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787853241.455975:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac4571000/MGS 00000020:00000080:1.0:1787853241.455978:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4571000/MGS for MGS 00000020:01000000:1.0:1787853241.455985:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1787853241.456190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4572800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787853241.456310:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787853241.456315:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853241.456321:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787853241.456328:0:20707:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cfbe6bb6800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787853241.456334:0:20707:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8cfac3d9cd70) has exports, disconnecting them 00000020:00080000:1.0:1787853241.456339:0:20707:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cfbe6bb6800), last request at 1787853147 00000020:00000080:1.0:1787853241.456343:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2537 00000020:00080000:1.0:1787853241.456354:0:20707:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfbe6bb6800): rc 0 00000020:00000080:1.0:1787853241.456358:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbe6bb6800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787853241.458282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe6bb6800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787853241.458322:0:20707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787853241.458326:0:20707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853241.458331:0:20707:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853241.458336:0:20707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853241.458369:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbe6bb0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787853241.458537:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853241.458546:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787853241.458551:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfbe6bb3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787853241.458554:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe6bb3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787853241.458559:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787853241.458635:0:20707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac4573800 1 00000020:00000080:0.0:1787853241.458641:0:20707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2426 00000020:00000080:0.0:1787853241.458647:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac4574800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787853241.458657:0:20707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787853241.458664:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4574800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787853241.458673:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853241.458677:0:20707:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787853241.458681:0:20707:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cfbfdc84d70) has no exports 00000020:00000080:1.0:1787853241.554677:0:20707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853241.554692:0:20707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787853241.554699:0:20707:0:(genops.c:885:class_export_put()) final put ffff8cfac4573000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853241.554704:0:20707:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4573000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787853241.554718:0:20707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787853241.555036:0:20707:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfac4571800 00000020:02000400:1.0:1787853241.555101:0:20707:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787853241.999979:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbe6050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491694976:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787853242.000023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853242.000027:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787853242.000031:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853242.000036:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1787853242.000041:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787853242.000048:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfbc8f8b000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853242.000050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.000069:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4c043c0 x1874699491695232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853242.000094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853242.000100:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3645:1874699491695104:0@lo:400:kworker.0 00000400:00000100:3.0:1787853242.000121:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699491695104 offset 0 length 224: 4 00000100:00100000:2.0:1787853242.000138:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491695232:0@lo:38:kworker.0 00000100:00100000:3.0:1787853242.000148:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac3f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491695616:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853242.000192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853242.000212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853242.000217:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac3f7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491695744:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000217:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695616 00000100:00100000:2.0:1787853242.000224:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695616 00000100:00100000:3.0:1787853242.000239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.000254:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695744 00000100:00100000:2.0:1787853242.000256:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695744 00000100:00100000:2.0:1787853242.000287:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787853242.000296:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000338:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491695744:12345-0@lo:400:kworker.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853242.000344:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787853242.000360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac3f7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491695488:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000360:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787853242.000364:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1874699491695616:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787853242.000376:0:17141:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787853242.000385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853242.000396:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491696000:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000398:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1874699491695616:12345-0@lo:400:kworker.0 Request processed in 32us (206us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787853242.000403:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787853242.000413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.000413:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695488 00000100:00100000:2.0:1787853242.000416:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695488 00000100:00100000:3.0:1787853242.000423:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787853242.000425:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696000 00000100:00100000:3.0:1787853242.000427:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac2532d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491695360:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000427:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696000 00000100:00100000:2.0:1787853242.000439:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787853242.000445:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491696000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.000460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.000470:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491696000:12345-0@lo:400:kworker.0 Request processed in 25us (56us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853242.000474:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491695872:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000476:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787853242.000487:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787853242.000490:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874699491695488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.000493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787853242.000495:0:17141:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00010000:00080000:3.0:1787853242.000514:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac47f4000 x1874699491696000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853242.000514:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874699491695488:12345-0@lo:400:kworker.0 Request processed in 22us (128us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787853242.000520:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787853242.000527:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491696000:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.000528:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695872 00000100:00100000:2.0:1787853242.000530:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695872 00000100:00100000:2.0:1787853242.000540:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853242.000543:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874699491695872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787853242.000546:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000020:00080000:2.0:1787853242.000548:0:17141:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1787853242.000550:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cfac2df7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787853242.000554:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787853242.000565:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874699491695872:12345-0@lo:400:kworker.0 Request processed in 20us (72us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787853242.000569:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787853242.000583:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853242.000656:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491694976 00000100:00100000:1.0:1787853242.000660:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491694976 00000100:00100000:1.0:1787853242.000697:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787853242.000704:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491694976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787853242.000736:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853242.000768:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491694976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853242.000774:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787853242.001129:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853242.002035:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695232 00000100:00100000:0.0:1787853242.002044:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695232 00000100:00100000:0.0:1787853242.002078:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787853242.002085:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491695232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787853242.002103:0:17145:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853242.005099:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491695360 00000100:00100000:1.0:1787853242.005112:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491695360 00000100:00100000:1.0:1787853242.005175:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787853242.005184:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491695360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853242.005267:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491695360:12345-0@lo:400:kworker.0 Request processed in 84us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853242.005275:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787853242.005303:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853242.014311:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cfac2df7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853242.014322:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:3.0:1787853242.014331:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cfac2df7000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853242.014365:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4752580 x1874699491696128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853242.014413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac3f7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491695488:0@lo:400:kworker.0 00000100:00100000:3.0:1787853242.014463:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac2532d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491695360:0@lo:400:kworker.0 00000100:00080000:3.0:1787853242.014477:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787853242.014480:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787853242.014483:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787853242.014486:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853242.014489:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1787853242.014493:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfac3f77800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853242.014506:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4750b40 x1874699491696256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853242.014517:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491695872:0@lo:400:kworker.0 00000100:00100000:1.0:1787853242.018216:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874699491696128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787853242.018297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853242.018336:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491696256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787853242.018359:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853242.018402:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696128 00000100:00100000:1.0:1787853242.018414:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696128 00000100:00100000:1.0:1787853242.019621:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696256 00000100:00100000:1.0:1787853242.019630:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696256 00000100:00100000:1.0:1787853242.019668:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853242.019676:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6053840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1787853242.019700:0:17141:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853242.019772:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6053840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 94us (1475us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787853242.019779:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853242.019796:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787853242.019800:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe6052580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696256:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1787853242.019809:0:17141:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853242.019839:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe6052580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37us (1479us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787853242.019860:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787853242.019921:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac2df7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853242.019926:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787853242.019930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874699491696128:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1787853242.020047:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853242.020053:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787853242.020057:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491696256:0@lo:38:ptlrpcd_00_01.0 00010000:00080000:2.0:1787853242.023937:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac3f7d680 x1874699491695744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853242.024012:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac3f7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491695744:0@lo:400:kworker.0 00000100:00080000:2.0:1787853242.024030:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787853242.024036:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cfac253a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787853242.024040:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787853242.024045:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cfac253a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853242.024049:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1787853242.024057:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfac253a800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853242.024087:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47f6580 x1874699491696384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853242.024110:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac3f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491695616:0@lo:400:kworker.0 00000100:00100000:2.0:1787853242.024133:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbe6050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491694976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787853242.024169:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491696384:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787853242.024299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853242.024347:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696384 00000100:00100000:2.0:1787853242.024353:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696384 00000100:00100000:2.0:1787853242.024388:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853242.024395:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696384:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787853242.024415:0:17141:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787853242.024454:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491696384:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787853242.024476:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787853242.024508:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac253a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853242.024512:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787853242.024515:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491696384:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787853242.035576:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491695232:12345-0@lo:38:kworker.0 Request processed in 33481us (35400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853242.035591:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787853242.036092:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853242.036098:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787853242.036103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491695232:0@lo:38:kworker.0 00010000:00010000:0.0:1787853242.320126:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853243.354621:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853244.049059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853244.049084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491696512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853244.049155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853244.049232:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696512 00000100:00100000:2.0:1787853244.049241:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696512 00000100:00100000:2.0:1787853244.049896:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853244.049908:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491696512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787853244.049948:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853244.049998:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491696512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853244.050006:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853244.051187:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491696512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787853244.052577:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853244.370170:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853244.502083:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787853245.092329:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853245.092349:0:19458:0:(genops.c:885:class_export_put()) final put ffff8cfbc2c43800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787853245.097067:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc2c43800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787853245.097126:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6d3800 for lustre-OST0001 00010000:00010000:0.0:1787853245.393164:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787853245.483963:0:20909:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787853245.498234:0:20909:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787853245.498294:0:20909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.498309:0:20909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.498317:0:20909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.498345:0:20909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.498372:0:20909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853245.498378:0:20909:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787853245.498402:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853245.498407:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787853245.498413:0:20909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853245.498420:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfac2df7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787853245.498425:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853245.498426:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787853245.498439:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787853245.499373:0:20708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853245.499382:0:20708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853245.499393:0:20708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95600 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853245.499397:0:20708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853245.499407:0:20708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853245.499414:0:20708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853245.499420:0:20708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853245.499423:0:20708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787853245.499425:0:20708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787853245.499477:0:20708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853245.499484:0:20708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853245.499521:0:20708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853245.499527:0:20708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95600/0xe2bf4b958af2625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af262c expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853245.499540:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853245.499542:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853245.499553:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853245.499573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491696640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853245.499650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853245.499730:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696640 00000100:00100000:0.0:1787853245.499736:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696640 00000100:00100000:0.0:1787853245.499775:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853245.499783:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1874699491696640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787853245.499788:0:17126:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853245 with bad export cookie 1021178817423549513 00010000:00010000:2.0:1787853245.505350:0:20909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505368:0:20909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505376:0:20909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505384:0:20909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505409:0:20909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853245.505429:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853245.505436:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505464:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95a00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853245.505468:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505477:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853245.505485:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853245.505491:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853245.505493:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1787853245.505530:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505536:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853245.505568:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505575:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95a00/0xe2bf4b958af2584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af258b expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505587:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.505589:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.505591:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853245.505616:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491696768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853245.505707:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853245.505784:0:20909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505804:0:20909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505811:0:20909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505817:0:20909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505835:0:20909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853245.505867:0:20909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505875:0:20909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505880:0:20909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505886:0:20909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505899:0:20909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853245.505907:0:20708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853245.505912:0:20708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505919:0:20708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240000 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853245.505927:0:20708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505935:0:20708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853245.505941:0:20708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853245.505946:0:20708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853245.505948:0:20708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787853245.505950:0:20708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787853245.505966:0:20708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505971:0:20708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853245.505981:0:20708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.505988:0:20708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240000/0xe2bf4b958af2878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af287f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506002:0:20708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853245.506005:0:20708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506010:0:20708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853245.506013:0:20708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506019:0:20708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853245.506032:0:20708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853245.506037:0:20708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787853245.506039:0:20708:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787853245.506040:0:20708:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787853245.506056:0:20708:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506061:0:20708:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853245.506077:0:20708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506083:0:20708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241400/0xe2bf4b958af2a1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af2a23 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506090:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.506092:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.506094:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853245.506102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853245.506110:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491696896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853245.506133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853245.506160:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853245.506167:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491697024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853245.506186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853245.506203:0:20909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506211:0:20909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506222:0:20909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506229:0:20909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506239:0:20909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853245.506242:0:20909:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1787853245.506245:0:20909:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1787853245.506271:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853245.506275:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506281:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95c00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853245.506283:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506289:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853245.506296:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853245.506301:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853245.506302:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787853245.506304:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787853245.506317:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506323:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853245.506337:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506343:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af2576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2bf4b958af257d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853245.506353:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.506355:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853245.506356:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853245.506365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4d11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491697152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853245.506388:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787853245.506411:0:20909:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787853245.506415:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787853245.506419:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853245.506424:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787853245.506429:0:20909:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cfac3c5a800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853245.506434:0:20909:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cfac253e800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853245.506439:0:20909:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8cfbe0258000) has exports, disconnecting them 00000020:00080000:2.0:1787853245.506442:0:20909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cfac3c5a800), last request at 1787853241 00000020:00000080:2.0:1787853245.506449:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af286a 00000100:00080000:2.0:1787853245.506464:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c5b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787853245.506495:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853245.506506:0:20909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac3c5a800): rc 0 00000020:00000080:2.0:1787853245.506508:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac3c5a800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787853245.506518:0:20909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cfac253e800), last request at 1787853241 00000020:00000080:2.0:1787853245.506521:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2705 00000100:00080000:2.0:1787853245.506526:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfac253b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787853245.506533:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853245.506538:0:20909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac253e800): rc 0 00000020:00000080:2.0:1787853245.506545:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac253e800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787853245.506552:0:20909:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9b8f01d5fae0 00000100:00080000:2.0:1787853245.506568:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853245.506575:0:20909:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8cfbd558c000 x1874699491694720/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787853255 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853245.506586:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787853245.507438:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491694720:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787853245.507468:0:20909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853245.507472:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787853245.507634:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787853245.507638:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787853245.507650:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787853245.509807:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696768 00000100:00100000:1.0:1787853245.509824:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696768 00000100:00100000:1.0:1787853245.509877:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491696896 00000100:00100000:1.0:1787853245.509880:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491696896 00000100:00100000:1.0:1787853245.509908:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491697024 00000100:00100000:1.0:1787853245.509911:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491697024 00000100:00100000:1.0:1787853245.509919:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491697152 00000100:00100000:1.0:1787853245.509922:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491697152 00000100:00100000:1.0:1787853245.509936:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853245.509944:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874699491696768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787853245.509952:0:17125:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853245 with bad export cookie 1021178817423549513 00000100:00100000:1.0:1787853245.510051:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874699491696768:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (4343us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853245.510057:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853245.510075:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853245.510079:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874699491696896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787853245.510082:0:17125:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853245 with bad export cookie 1021178817423549513 00000100:00100000:1.0:1787853245.510104:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874699491696896:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (3971us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853245.510109:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853245.510119:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787853245.510122:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1874699491697024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787853245.510126:0:17125:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853245 with bad export cookie 1021178817423549513 00000100:00100000:1.0:1787853245.510155:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d12d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1874699491697024:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (3968us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853245.510163:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787853245.510173:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853245.510176:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4454c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1874699491697152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787853245.510180:0:17125:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853245 with bad export cookie 1021178817423549513 00000100:00100000:1.0:1787853245.510201:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4454c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1874699491697152:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (3812us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853245.510216:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787853245.510255:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853245.510260:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8cfbc80a9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787853245.510263:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:3.0:1787853245.511440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c5a800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787853245.511505:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac253e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787853245.511530:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3c5b800 for lustre-MDT0001 00000020:00000080:3.0:1787853245.511534:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac253b800 for lustre-MDT0001 00000100:00080000:2.0:1787853245.513428:0:20909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787853245.522313:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3195800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787853245.522367:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787853245.522373:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787853245.522395:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853245.522500:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491697280:0@lo:9:umount.0 00000100:00100000:2.0:1787853245.522814:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787853245.522894:0:20909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787853245.522949:0:20909:0:(import.c:65:import_set_state_nolock()) ffff8cfac39d3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787853245.522971:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491697408:0@lo:9:umount.0 00000100:00100000:2.0:1787853245.523010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787853245.523077:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cfbe0258000) has no exports 00010000:00010000:0.0:1787853245.526462:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853245.526688:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1874699491696640:12345-0@lo:103:ldlm_bl.0 Request processed in 26900us (27032us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787853245.526702:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787853245.527109:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853245.572004:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787853245.572008:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787853245.572018:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4c9da40 x1874699491695104/t0(0) o400->MGC192.168.201.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787853257 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853245.572043:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfc32ed00 x1874699491696640/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853261 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853245.572052:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac47f4000 x1874699491696768/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853261 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853245.572060:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4c043c0 x1874699491696896/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853261 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853245.572068:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbff4ce1c0 x1874699491697024/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853261 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853245.572075:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4d11680 x1874699491697152/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853261 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787853245.572083:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787853245.572085:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787853245.572086:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787853245.573582:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cfbc80a9000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787853245.573617:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491696768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853245.573656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3643:1874699491696896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853245.573732:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491697280 00000100:00100000:0.0:1787853245.573742:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491697280 00000100:00100000:0.0:1787853245.573799:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491697408 00000100:00100000:0.0:1787853245.573802:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491697408 00000100:00100000:0.0:1787853245.573862:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853245.573873:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874699491697280:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787853245.573905:0:18645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af272f 00000100:00080000:0.0:1787853245.573916:0:18645:0:(import.c:65:import_set_state_nolock()) ffff8cfac3a39800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853245.573962:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787853245.574149:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3642:x1874699491697280:12345-0@lo:9:umount.0 Request processed in 278us (51335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853245.574167:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853245.574180:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787853245.574186:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874699491697408:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787853245.574198:0:18645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af289b 00000100:00080000:0.0:1787853245.574204:0:18645:0:(import.c:65:import_set_state_nolock()) ffff8cfbde6d7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853245.574225:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787853245.574286:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3642:x1874699491697408:12345-0@lo:9:umount.0 Request processed in 101us (51275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853245.574291:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787853245.574305:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787853245.574312:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853245.574315:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853245.574340:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac39d3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787853245.574349:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787853245.574350:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853245.574353:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491697408:0@lo:9:umount.0 00000100:00080000:0.0:1787853245.574360:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3195800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787853245.574366:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787853245.574367:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853245.574369:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4d13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491697280:0@lo:9:umount.0 00000100:00100000:3.0:1787853245.575051:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3645:1874699491695104:0@lo:400:kworker.0 00000100:00080000:1.0:1787853245.579366:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8cfbc80a9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853245.579378:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1787853245.579386:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff8cfbc80a9000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853245.579438:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd90000 x1874699491697536/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853245.579486:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491697024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853245.579506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491696640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853245.579535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4d11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3646:1874699491697152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853245.580250:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3642:1874699491697536:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787853245.580294:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699491697536 offset 0 length 520: 4 00000020:00080000:0.0:1787853245.590347:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cfbe0258000) has no exports 00000020:01000000:1.0:1787853245.653792:0:20909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac3e4c540 - data ffff8cfbdeaa1ca8/ffff8cfac4c54c00 00000020:01000000:1.0:1787853245.654237:0:20909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac2e2a300 - data ffff8cfbdea3f510/ffff8cfbc8776800 00000001:00000004:1.0:1787853245.681104:0:20909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787853245.741257:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787853245.741267:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853245.741273:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787853245.745820:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787853245.745829:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787853245.746273:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853245.746285:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787853245.748089:0:17880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787853245.748096:0:17880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1787853245.748120:0:17880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787853245.749291:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787853245.749297:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787853245.749318:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853245.749321:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787853245.749830:0:17883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787853245.749835:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787853245.749876:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787853245.752191:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2599 00000020:00000080:0.0:1787853245.752203:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc8114000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787853245.753308:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25ae 00000020:00000080:0.0:1787853245.753317:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbcaf14000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787853245.753323:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787853245.753329:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853245.753337:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853245.753341:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cfbe025b3a0) has no exports 00000020:00000080:3.0:1787853245.753505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc8114000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787853245.753512:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbcaf14000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1787853245.754096:0:20909:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787853245.754103:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2602 00000020:00000080:0.0:1787853245.754107:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac39d0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787853245.754145:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787853245.754149:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853245.754153:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787853245.754155:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8cfbfce433a0) has no exports 00000020:00000080:0.0:1787853245.754159:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25fb 00000020:00000080:0.0:1787853245.754162:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac39d3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787853245.758096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac39d0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1787853245.770250:0:20909:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787853245.770260:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787853245.770264:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787853245.770270:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787853245.770272:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853245.770301:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853245.770309:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787853245.770317:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25ed 00000020:00000080:1.0:1787853245.770325:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac440c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787853245.770330:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787853245.770337:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853245.770340:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787853245.770343:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cfbfce44d70) has no exports 00000020:00000080:1.0:1787853245.770349:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25e6 00000020:00000080:1.0:1787853245.770352:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc3196000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787853245.770653:0:20909:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787853245.770656:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787853245.770668:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787853245.770671:0:20909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787853245.770673:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853245.770693:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853245.770698:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787853245.770719:0:20909:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787853245.770735:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25d1 00000020:00000080:1.0:1787853245.770740:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac4408800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787853245.770745:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787853245.770748:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853245.770752:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787853245.770754:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8cfbfce40000) has no exports 00000020:00000080:1.0:1787853245.770759:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25ca 00000020:00000080:1.0:1787853245.770761:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc3192000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787853245.771450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac39d3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787853245.771467:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac39d3000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787853245.771473:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac440b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787853245.771475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac440b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787853245.771478:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787853245.771556:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac440c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787853245.771561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3196000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787853245.771564:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbc3195800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787853245.771568:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac440f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787853245.771570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac440f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787853245.771573:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787853245.771597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac4408800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787853245.771601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3192000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787853245.771999:0:20909:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787853245.772003:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853245.772006:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853245.772011:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853245.772050:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853245.772056:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787853245.772080:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853245.772083:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787853245.772086:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc7d2d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787853245.772089:0:20909:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc7d2d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787853245.772096:0:20909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787853245.772238:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25b5 00000020:00000080:0.0:1787853245.772244:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbcaf14800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787853245.772248:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787853245.772251:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853245.772255:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853245.772257:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cfbe02599d0) has no exports 00000020:00000080:0.0:1787853245.772275:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853245.772279:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787853245.772282:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af25bc 00000020:00000080:0.0:1787853245.772285:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbcaf13000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787853245.772292:0:20909:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfbfb66c800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787853245.772294:0:20909:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbfb66c800 2 00000020:01000004:0.0:1787853245.772297:0:20909:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfbfb66c800 from lustre-MDT0001 00000020:00000080:0.0:1787853245.772313:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853245.772316:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787853245.772318:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc8111800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787853245.772320:0:20909:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc8111800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787853245.772326:0:20909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787853245.772352:0:20909:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787853245.772356:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787853245.772358:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853245.772361:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787853245.772368:0:20909:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8cfac2df5000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853245.772372:0:20909:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8cfbe60833a0) has exports, disconnecting them 00000020:00080000:0.0:1787853245.772376:0:20909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8cfac2df5000), last request at 1787853162 00000020:00000080:0.0:1787853245.772379:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af263a 00000020:00080000:0.0:1787853245.772390:0:20909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac2df5000): rc 0 00000020:00000080:0.0:1787853245.772393:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfac2df5000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787853245.773690:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbc8f8b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787853245.773701:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfbc3193000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787853245.773711:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3193000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787853245.773718:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787853245.773813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbcaf14800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787853245.773826:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfbc8112800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787853245.773828:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc8112800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787853245.773831:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787853245.773930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbcaf13000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787853245.773934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac2df5000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787853245.827106:0:20909:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787853245.827115:0:20909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787853245.827119:0:20909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787853245.827127:0:20909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853245.827699:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853245.827771:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787853245.827782:0:20909:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbfb66c800 1 00000020:00000080:1.0:1787853245.827790:0:20909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2561 00000020:00000080:1.0:1787853245.827798:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbe6bb5800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787853245.828081:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac2df7000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787853245.828089:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac3f74800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787853245.828092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3f74800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787853245.828104:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1787853245.828800:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787853245.828807:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853245.828813:0:20909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787853245.828817:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8cfac27e19d0) has no exports 00000020:00000080:3.0:1787853245.828898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe6bb5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787853245.904320:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853245.904332:0:20909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787853245.904337:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbfcdab800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787853245.904341:0:20909:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbfcdab800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787853245.904346:0:20909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787853245.904617:0:20909:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfbfcdaf000 00000020:01000000:3.0:1787853245.904636:0:20909:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787853245.904640:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853245.904645:0:20909:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787853245.904649:0:20909:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cfac3d98000) has no exports 00000100:00100000:2.0:1787853245.905906:0:17138:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cfbfccc9600:17138] 0 exiting: rc = 1 00000100:00100000:2.0:1787853245.906021:0:17141:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cfbc8f4be00:17141] 2 exiting: rc = 0 00000100:00100000:2.0:1787853245.906079:0:17140:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cfbc8f4ba00:17140] 1 exiting: rc = 0 00000100:00100000:1.0:1787853245.906286:0:20276:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cfac463d000:20276] 3 exiting: rc = 0 00000100:00100000:3.0:1787853245.906395:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906403:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906409:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906415:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906420:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906434:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906440:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906445:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906450:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906455:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906461:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906473:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906479:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906484:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906489:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906495:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906500:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906505:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906512:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906517:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906522:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906527:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906533:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906538:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906543:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906548:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906553:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906559:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906565:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906569:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906575:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906580:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906585:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906592:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906597:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906603:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906608:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906614:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906619:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906624:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906630:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906635:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906640:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906646:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906652:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906666:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906681:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906687:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906693:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906697:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906887:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906896:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906902:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906908:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906913:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906918:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906923:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906928:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906933:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906939:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906945:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906950:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906956:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853245.906961:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853245.915361:0:17143:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cfbc8f4aa00:17143] 1 exiting: rc = 0 00000100:00100000:1.0:1787853245.915498:0:17142:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cfbc8f4a400:17142] 0 exiting: rc = 1 00000100:00100000:2.0:1787853245.915627:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915637:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915644:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915649:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915654:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915668:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915673:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915679:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915685:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915690:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915695:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915709:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915715:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915721:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915725:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915730:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915735:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915740:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915745:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915751:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915757:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915762:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915767:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915771:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915776:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915782:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915787:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915793:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915798:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915803:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915808:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915813:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915818:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915823:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915828:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915873:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915878:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915883:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915888:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915893:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915898:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915903:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915908:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915913:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915918:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915923:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915929:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915934:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915939:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915944:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915948:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915953:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915957:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915963:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915968:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.915973:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916130:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916140:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916145:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916151:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916156:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916161:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916166:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916172:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.916601:0:17145:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cfbc7425200:17145] 1 exiting: rc = 0 00000100:00100000:1.0:1787853245.916807:0:17144:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cfac3848a00:17144] 0 exiting: rc = 1 00000100:00100000:0.0:1787853245.916950:0:17881:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8cfbc85f6000:17881] 2 exiting: rc = 0 00000100:00100000:2.0:1787853245.917130:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917138:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917143:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917150:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917155:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917172:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917177:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917182:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917188:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917193:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917199:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917205:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917224:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917231:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917237:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917243:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917249:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917254:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917260:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917266:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917271:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917276:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917284:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917290:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917311:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917320:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917328:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917337:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917345:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917351:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917368:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917375:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917381:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917395:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917403:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.917409:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.918645:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.918664:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.918671:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.918677:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.918692:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919149:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919159:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919166:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919172:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919178:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919184:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919190:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919210:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919218:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919224:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919229:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919235:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919240:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919245:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919251:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919257:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919263:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919269:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919275:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919296:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919302:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919308:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.919313:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.933015:0:17147:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cfbc7424000:17147] 1 exiting: rc = 0 00000100:00100000:3.0:1787853245.933157:0:17146:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cfbc7425e00:17146] 0 exiting: rc = 1 00000100:00100000:0.0:1787853245.933408:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933416:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933441:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933446:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933450:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933455:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933459:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933464:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933469:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933473:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933477:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933482:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933487:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933492:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933497:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933501:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933505:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933510:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933515:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933520:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933525:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933530:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933534:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933539:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933545:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933549:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933555:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933560:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933566:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933572:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933577:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933582:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933587:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933592:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933597:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933602:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933607:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933620:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933626:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933631:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933636:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933641:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933646:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933652:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933666:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933670:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933675:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933680:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933685:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933689:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933695:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933699:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933820:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933827:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933832:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933837:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933940:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933946:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933952:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933957:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933961:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933966:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.933971:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.934043:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.934526:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cfbc7425a00:17149] 1 exiting: rc = 0 00000100:00100000:3.0:1787853245.935082:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cfbc7425c00:17148] 0 exiting: rc = 1 00000100:00100000:0.0:1787853245.935206:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935213:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935219:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935224:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935228:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935233:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935239:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935245:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935264:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935270:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935275:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935281:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935287:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935292:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935298:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935303:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935308:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935314:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935319:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935325:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935330:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935335:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935340:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935345:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935350:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935355:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935361:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935366:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935371:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935375:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935381:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935387:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935392:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935396:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935401:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935405:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935411:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935416:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935489:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935497:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935502:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935506:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935513:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935526:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935531:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935536:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935542:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935547:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935552:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935557:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935562:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935566:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935571:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935576:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935581:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935586:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935591:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935595:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935600:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935605:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935611:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935615:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935621:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.935626:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853245.936314:0:17150:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cfbc74c5800:17150] 0 exiting: rc = 1 00000100:00100000:3.0:1787853245.936488:0:17151:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cfbc74c5000:17151] 1 exiting: rc = 0 00000100:00100000:0.0:1787853245.936592:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936598:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936603:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936608:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936612:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936617:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936622:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936627:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936633:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936638:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936643:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936647:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936652:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936665:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936682:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936687:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936692:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936697:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936774:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936782:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936787:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936792:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936798:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936803:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936808:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936813:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936819:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936824:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936829:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.936834:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937316:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937328:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937333:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937338:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937344:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937349:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937354:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937359:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937364:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937370:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937375:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937380:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937386:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937390:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937395:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937400:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937406:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937410:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937415:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937443:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937448:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937454:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937459:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937464:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937470:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937475:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937480:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937485:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937490:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937495:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937500:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937505:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937510:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.937514:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.938371:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cfbe6abe400:17154] 2 exiting: rc = 0 00000100:00100000:3.0:1787853245.938601:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cfbc74c5a00:17152] 0 exiting: rc = 1 00000100:00100000:3.0:1787853245.938886:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cfbe6abf200:17153] 1 exiting: rc = 0 00000100:00100000:0.0:1787853245.939130:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939137:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939143:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939163:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939170:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939175:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939180:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939186:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939191:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939197:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939203:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939209:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939214:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939219:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939224:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939230:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939235:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939241:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939247:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939266:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939272:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939277:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939282:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939287:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939291:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939297:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939303:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939321:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939329:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939335:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939340:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939345:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939351:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939357:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939363:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939369:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939374:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939380:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939385:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939662:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939673:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939679:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939685:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939691:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.939696:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940230:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940240:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940246:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940251:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940257:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940263:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940284:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940290:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940295:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940309:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940314:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940318:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940323:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940328:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940333:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940337:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940343:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940348:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853245.940354:0:20909:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787853245.945828:0:20909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853245.945839:0:20909:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787853245.945862:0:20909:0:(genops.c:885:class_export_put()) final put ffff8cfbc80ae800/MDS_uuid 00000020:00000080:0.0:1787853245.945866:0:20909:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc80ae800/MDS_uuid for MDS 00000020:01000000:0.0:1787853245.945871:0:20909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787853245.946145:0:20909:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787853246.416198:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853247.122518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853247.122527:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853247.122531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853247.122534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787853247.122538:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfac253a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853247.122554:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 580 00000100:00080000:1.0:1787853247.122570:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853247.122577:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfac253a800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853247.122613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd90b40 x1874699491697664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853247.122670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853247.122674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787853247.122676:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853247.122680:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 580 00000100:00080000:1.0:1787853247.123141:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853247.123145:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfac3f77800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853247.123160:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd92940 x1874699491697920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853247.123241:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491697664:0@lo:38:kworker.0 00000400:00000100:1.0:1787853247.123296:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491697664 offset 0 length 520: 4 00000100:00100000:1.0:1787853247.123326:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491697920:0@lo:38:kworker.0 00000400:00000100:1.0:1787853247.123342:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491697920 offset 0 length 520: 4 00000100:00100000:1.0:1787853247.123370:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491697792:0@lo:400:kworker.0 00000400:00000100:1.0:1787853247.123389:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491697792 offset 0 length 224: 4 00000100:00100000:1.0:1787853247.123416:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853247.123422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491698048:0@lo:400:kworker.0 00000400:00000100:1.0:1787853247.123439:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698048 offset 0 length 224: 4 00010000:00010000:0.0:1787853247.443173:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853248.473605:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853249.488763:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853250.134388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853250.134431:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853250.134434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853250.134438:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853250.134498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853250.134512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853250.134552:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491698304:0@lo:400:kworker.0 00000400:00000100:2.0:1787853250.134618:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698304 offset 0 length 224: 4 00000100:00100000:3.0:1787853250.135329:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491698176:0@lo:400:kworker.0 00000400:00000100:3.0:1787853250.151135:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698176 offset 0 length 224: 4 00010000:00010000:0.0:1787853250.515008:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853250.705419:0:19458:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787853250.705429:0:19458:0:(genops.c:885:class_export_put()) final put ffff8cfbde6d2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787853250.705450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6d2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787853250.705488:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbde6d7800 for lustre-OST0001 00000001:00100000:3.0:1787853250.711865:0:18641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787853250.711876:0:18641:0:(genops.c:885:class_export_put()) final put ffff8cfac3a3f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787853250.711938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3a3f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787853250.712231:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3a39800 for lustre-OST0000 00000020:01000004:3.0:1787853251.469673:0:21111:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787853251.485357:0:21111:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787853251.485410:0:21111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853251.485442:0:21111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853251.485450:0:21111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853251.485457:0:21111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853251.485477:0:21111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787853251.485482:0:21111:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787853251.485506:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787853251.485518:0:21111:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd90b40 x1874699491697664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853262 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853251.485535:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787853251.485540:0:21111:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787853251.485546:0:21111:0:(import.c:65:import_set_state_nolock()) ffff8cfac253a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787853251.485551:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787853251.485555:0:21111:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd90b40 x1874699491697664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853262 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853251.485573:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853251.485576:0:21111:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1787853251.487010:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853251.487021:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853251.487031:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95800 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:1.0:1787853251.487035:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853251.487043:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853251.487051:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853251.487056:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853251.487058:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787853251.487061:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787853251.487075:0:17128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:1.0:1787853251.487079:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853251.487096:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95800/0xe2bf4b958af26d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af26db expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853251.487110:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853251.487112:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853251.487113:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853251.487727:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491697664:0@lo:38:kworker.0 00000100:00080000:3.0:1787853251.488707:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787853251.488720:0:21111:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd93c00 x1874699491697792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853263 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853251.488742:0:21111:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbf60b1e00 x1874699491698176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853251.488790:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787853251.488795:0:21111:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787853251.488818:0:21111:0:(import.c:65:import_set_state_nolock()) ffff8cfac253b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787853251.489030:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1874699491698432:0@lo:39:umount.0 00000400:00000100:2.0:1787853251.489078:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698432 offset 0 length 224: 4 00000100:00100000:0.0:1787853251.489332:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491698176:0@lo:400:kworker.0 00000100:00100000:1.0:1787853251.490359:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491697792:0@lo:400:kworker.0 00010000:00010000:0.0:1787853251.536114:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853252.176013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853252.176022:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853252.176043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853252.176047:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787853252.176209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853252.178221:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491698560:0@lo:400:kworker.0 00000400:00000100:3.0:1787853252.178294:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698560 offset 0 length 224: 4 00010000:00010000:0.0:1787853252.560252:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853253.585134:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853254.609074:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853255.567981:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853245/real 1787853245] req@ffff8cfbfbd90000 x1874699491697536/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787853255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853255.568016:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd90000 x1874699491697536/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787853255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787853255.568037:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc80a9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853255.568123:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787853255.568128:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3642:1874699491697536:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1787853255.575872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853255.575883:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787853255.575888:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbc80a9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853255.575896:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1787853255.575902:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787853255.575910:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff8cfbc80a9000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853255.575948:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47521c0 x1874699491698688/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853255.575979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853255.575983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787853255.576046:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853255.576062:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491698816:0@lo:400:kworker.0 00000400:00000100:3.0:1787853255.576112:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698816 offset 0 length 224: 4 00000100:00100000:2.0:1787853255.576280:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3642:1874699491698688:0@lo:250:kworker.0 00000400:00000100:2.0:1787853255.576306:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874699491698688 offset 0 length 520: 4 00010000:00010000:0.0:1787853255.636042:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853256.656124:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853257.680877:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853258.704112:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853259.734727:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853260.752021:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853260.944491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853260.944503:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853260.944506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853260.944509:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853260.944767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853260.944804:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491698944:0@lo:400:kworker.0 00000400:00000100:2.0:1787853260.944879:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491698944 offset 0 length 224: 4 00000100:00100000:2.0:1787853261.712319:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853251/real 1787853251] req@ffff8cfac4750f00 x1874699491698432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853261.712353:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfac4750f00 x1874699491698432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787853261.712405:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac253b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787853261.712431:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1874699491698432:0@lo:39:umount.0 00000100:00080000:3.0:1787853261.712595:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787853261.712600:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853261.712604:0:21111:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787853261.713589:0:21111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713604:0:21111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713611:0:21111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713618:0:21111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713637:0:21111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853261.713643:0:21111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713650:0:21111:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713656:0:21111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713662:0:21111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853261.713681:0:21111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787853261.713685:0:21111:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787853261.713719:0:21111:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787853261.713722:0:21111:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787853261.713727:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853261.713733:0:21111:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787853261.713737:0:21111:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8cfbfce419d0) has no exports 00000020:00080000:3.0:1787853261.713760:0:21111:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8cfbfce419d0) has no exports 00010000:00010000:1.0:1787853261.713877:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853261.713884:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713892:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfccca400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:1.0:1787853261.713896:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713905:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853261.713912:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853261.713918:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853261.713920:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787853261.713922:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787853261.713935:0:17128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:1.0:1787853261.713939:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713945:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af26aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af26b1 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713959:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853261.713968:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713974:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccac00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:1.0:1787853261.713977:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.713984:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853261.713989:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853261.713994:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787853261.713997:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787853261.713998:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787853261.714003:0:17128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:1.0:1787853261.714006:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.714013:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccac00/0xe2bf4b958af2a0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2a15 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853261.714020:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853261.714022:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853261.714023:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853261.715838:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787853261.722943:0:21111:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac3b30b40 - data ffff8cfbde9e6798/ffff8cfbde6aac00 00000020:01000000:3.0:1787853261.723110:0:21111:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac2e2ac60 - data ffff8cfbde84dd80/ffff8cfac4c56400 00100000:10000000:3.0:1787853261.730242:0:21111:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787853261.738268:0:21111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af26bf 00000020:00000080:2.0:1787853261.738280:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfbc3033800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787853261.738306:0:21111:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfbe6aaf800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787853261.738310:0:21111:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbe6aaf800 2 00000020:01000004:2.0:1787853261.738313:0:21111:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfbe6aaf800 from lustre-OST0000 00000020:00000080:2.0:1787853261.738340:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853261.738350:0:21111:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787853261.738353:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfbc4b65000/lustre-OST0000_UUID 00000020:00000080:2.0:1787853261.738355:0:21111:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc4b65000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787853261.738362:0:21111:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787853261.738446:0:21111:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787853261.738451:0:21111:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787853261.738455:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853261.738460:0:21111:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787853261.738477:0:21111:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cfac2538800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853261.738483:0:21111:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8cfbe6080000) has exports, disconnecting them 00000020:00080000:2.0:1787853261.738488:0:21111:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cfac2538800), last request at 1787853179 00000020:00000080:2.0:1787853261.738493:0:21111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af26e9 00000020:00080000:2.0:1787853261.738503:0:21111:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac2538800): rc 0 00000020:00000080:2.0:1787853261.738507:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfac2538800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787853261.739280:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc3033800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787853261.739295:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac2538800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787853261.786286:0:21111:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787853261.786296:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853261.786301:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853261.786308:0:21111:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853261.786510:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853261.786519:0:21111:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787853261.786525:0:21111:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787853261.786533:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853261.786537:0:21111:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787853261.786544:0:21111:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8cfac253a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853261.786550:0:21111:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8cfbe6084d70) has exports, disconnecting them 00000020:00080000:0.0:1787853261.786555:0:21111:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8cfac253a000), last request at 1787853179 00000020:00000080:0.0:1787853261.786559:0:21111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af26fe 00000020:00080000:0.0:1787853261.786574:0:21111:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac253a000): rc 0 00000020:00000080:0.0:1787853261.786580:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfac253a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787853261.786898:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac253a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787853261.786916:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac3f73800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787853261.786920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3f73800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787853261.786931:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787853261.786997:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac253a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787853261.787891:0:21111:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787853261.787897:0:21111:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787853261.787900:0:21111:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853261.787905:0:21111:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853261.788066:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853261.788073:0:21111:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787853261.788080:0:21111:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbe6aaf800 1 00000020:00000080:0.0:1787853261.788086:0:21111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af269c 00000020:00000080:0.0:1787853261.788092:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfac443c000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787853261.788105:0:21111:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787853261.788108:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853261.788112:0:21111:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853261.788115:0:21111:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8cfbf71519d0) has no exports 00000020:00000080:0.0:1787853261.796422:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac253b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787853261.796438:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac253e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787853261.796442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac253e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787853261.796458:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787853261.796526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac443c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787853262.012587:0:21111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853262.012601:0:21111:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787853262.012606:0:21111:0:(genops.c:885:class_export_put()) final put ffff8cfbe6aae800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787853262.012611:0:21111:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbe6aae800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787853262.012622:0:21111:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787853262.012745:0:21111:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfbe6aab800 00000020:02000400:0.0:1787853262.012803:0:21111:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787853262.224415:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853262.736780:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853247/real 1787853247] req@ffff8cfbfbd92940 x1874699491697920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787853262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853262.736807:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd92940 x1874699491697920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787853262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787853262.736821:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853262.736866:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787853262.736870:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491697920:0@lo:38:kworker.0 00000100:00080000:3.0:1787853262.746990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853262.747000:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853262.747003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787853262.747006:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787853262.747010:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853262.747020:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 585 00000100:00080000:3.0:1787853262.747025:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787853262.747032:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfac3f77800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853262.747069:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4750780 x1874699491699072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853262.747145:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853262.747161:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874699491699200:0@lo:400:kworker.0 00000400:00000100:3.0:1787853262.747212:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491699200 offset 0 length 224: 4 00000100:00100000:2.0:1787853262.747448:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491699072:0@lo:38:kworker.0 00000400:00000100:2.0:1787853262.747472:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491699072 offset 0 length 520: 4 00010000:00010000:0.0:1787853263.248033:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787853263.785324:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853247/real 1787853247] req@ffff8cfbfbd92d00 x1874699491698048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853263.837673:0:3643:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8cfbfbd92d00 x1874699491698048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787853263.837689:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c5e000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787853263.837693:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787853263.869808:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1787853263.869949:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853263.869955:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853263.869958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853263.869961:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853263.869963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787853263.869966:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787853263.869969:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c5e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853263.869976:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1787853263.869985:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cfac3c5e000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853263.870020:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd912c0 x1874699491699328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853263.870061:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1874699491699328:0@lo:38:kworker.0 00000100:00100000:3.0:1787853263.871460:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491698048:0@lo:400:kworker.0 00000400:00000100:1.0:1787853263.871531:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874699491699328 offset 0 length 520: 4 00010000:00010000:1.0:1787853264.273049:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853265.296805:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787853266.068198:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853250/real 1787853250] req@ffff8cfbf60b0f00 x1874699491698304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853266.110334:0:3646:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8cfbf60b0f00 x1874699491698304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787853266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787853266.110349:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8cfac3c5e000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1787853266.110674:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491698304:0@lo:400:kworker.0 00010000:00010000:0.0:1787853266.320992:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853267.096491:0:21313:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787853267.116345:0:21313:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787853267.116436:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.116462:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.116470:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.116478:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853267.116508:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787853267.116514:0:21313:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787853267.116539:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853267.116552:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4750780 x1874699491699072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853267.116569:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787853267.116600:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853267.116617:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787853267.116622:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491699072:0@lo:38:kworker.0 00000100:00080000:0.0:1787853267.116651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853267.116655:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853267.116658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787853267.116662:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853267.116672:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787853267.116678:0:21313:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f77800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787853267.116683:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853267.116690:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787853267.116694:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787853267.117298:0:20708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853267.117307:0:20708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.117316:0:20708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbff4abc00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853267.117320:0:20708:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.117329:0:20708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853267.117336:0:20708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853267.117342:0:20708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853267.117344:0:20708:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787853267.117346:0:20708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787853267.117369:0:20708:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:2.0:1787853267.117374:0:20708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.117381:0:20708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbff4abc00/0xe2bf4b958af2839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2840 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.117403:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853267.117405:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853267.117407:0:20708:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853267.120230:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787853267.120252:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd93c00 x1874699491698560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120309:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4753480 x1874699491698816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853271 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120321:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac47503c0 x1874699491698944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853276 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120333:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4752940 x1874699491699200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120346:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd912c0 x1874699491699328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120356:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787853267.120389:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874699491699200:0@lo:400:kworker.0 00000100:00080000:3.0:1787853267.120421:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787853267.120427:0:21313:0:(import.c:65:import_set_state_nolock()) ffff8cfac3c5e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787853267.120433:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787853267.120437:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd93c00 x1874699491698560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853268 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120446:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac4753480 x1874699491698816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853271 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120453:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac47503c0 x1874699491698944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853276 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120461:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfbfbd912c0 x1874699491699328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853273 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853267.120467:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853267.120471:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1787853267.120598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491698816:0@lo:400:kworker.0 00000100:00100000:2.0:1787853267.120676:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491698560:0@lo:400:kworker.0 00000100:00100000:2.0:1787853267.120696:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491698944:0@lo:400:kworker.0 00000100:00100000:0.0:1787853267.121267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1874699491699328:0@lo:38:kworker.0 00010000:00010000:3.0:1787853267.125766:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.125805:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.125813:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.125820:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.125835:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853267.125931:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853267.125939:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.125947:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbff4aba00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:1.0:1787853267.125952:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.125961:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853267.125969:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853267.125974:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853267.125977:0:17127:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787853267.125988:0:17127:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:1.0:1787853267.125991:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.125998:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbff4aba00/0xe2bf4b958af280f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2816 expref: -99 pid: 19457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.126013:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853267.126015:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853267.126016:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853267.126629:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.126641:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.126648:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.126655:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853267.126701:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787853267.126705:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787853267.126710:0:21313:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787853267.126742:0:21313:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787853267.126746:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787853267.126750:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853267.126755:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787853267.126768:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8cfbf57d99d0) has no exports 00000020:00080000:3.0:1787853267.126791:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8cfbf57d99d0) has no exports 00000020:01000000:3.0:1787853267.132006:0:21313:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac2e2aba0 - data ffff8cfbc9a4b000/ffff8cfac2da7400 00010000:00010000:1.0:1787853267.132176:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853267.132187:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.132218:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2e00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:1.0:1787853267.132222:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.132233:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853267.132240:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853267.132246:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787853267.132249:0:17128:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787853267.132252:0:17128:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787853267.132270:0:17128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:1.0:1787853267.132274:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853267.132281:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff2e00/0xe2bf4b958af2a00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af2a07 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1787853267.133130:0:21313:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfac38c0c60 - data ffff8cfbde9a06c0/ffff8cfbfbd26000 00010000:00010000:0.0:1787853267.134424:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853267.134429:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853267.134432:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787853267.143570:0:21313:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787853267.148942:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2824 00000020:00000080:2.0:1787853267.148957:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac3c5e800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787853267.149020:0:21313:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfbde6d4000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787853267.149024:0:21313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbde6d4000 2 00000020:01000004:2.0:1787853267.149027:0:21313:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfbde6d4000 from lustre-OST0001 00000020:00000080:2.0:1787853267.149052:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853267.149061:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787853267.149064:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac3c59000/lustre-OST0001_UUID 00000020:00000080:2.0:1787853267.149067:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c59000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787853267.149082:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787853267.149200:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e5f0fee8-afcd-4dd4-be87-985382cb1f01->MGS 00010000:00010000:2.0:1787853267.149216:0:21313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95200/0xe2bf4b958af2568 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af256f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853267.149229:0:21313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95200/0xe2bf4b958af2568 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af256f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853267.149236:0:21313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787853267.149239:0:21313:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787853267.149242:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787853267.149255:0:21313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:2.0:1787853267.149259:0:21313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95200/0xe2bf4b958af2568 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af256f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853267.149301:0:21313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4795a00/0xe2bf4b958af2457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2bf4b958af245e expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853267.149309:0:21313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795a00/0xe2bf4b958af2457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2bf4b958af245e expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853267.149315:0:21313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853267.149318:0:21313:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787853267.149319:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787853267.149330:0:21313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfbc80a9000 00010000:00010000:2.0:1787853267.149333:0:21313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4795a00/0xe2bf4b958af2457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2bf4b958af245e expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787853267.149350:0:21313:0:(import.c:65:import_set_state_nolock()) ffff8cfbc80a9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787853267.149354:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787853267.149357:0:21313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787853267.149359:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787853267.149364:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787853267.149376:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfac47521c0 x1874699491698688/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787853270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787853267.149398:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787853267.149401:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1787853267.149705:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5f0fee8-afcd-4dd4-be87-985382cb1f01:3642:1874699491698688:0@lo:250:kworker.0 10000000:01000000:2.0:1787853267.149836:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787853267.149868:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2442 00000020:00000080:2.0:1787853267.149875:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfbc80a8800/e5f0fee8-afcd-4dd4-be87-985382cb1f01 00000020:00000080:0.0:1787853267.150028:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c5e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787853267.150282:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:2.0:1787853267.150295:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853267.150301:0:21313:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787853267.150305:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cfac3d9b3a0) has no exports 10000000:01000000:1.0:1787853267.150357:0:17136:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1787853267.150445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc80a8800/e5f0fee8-afcd-4dd4-be87-985382cb1f01 for MGC192.168.201.129@tcp 10000000:01000000:2.0:1787853267.150540:0:21313:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:2.0:1787853267.150551:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787853267.150554:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787853267.150557:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787853267.150558:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787853267.150608:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853267.150614:0:21313:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid e5f0fee8-afcd-4dd4-be87-985382cb1f01) 00000020:01000000:2.0:1787853267.150620:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787853267.150623:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853267.150626:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787853267.150631:0:21313:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cfbde6d1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853267.150636:0:21313:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8cfbc8124d70) has exports, disconnecting them 00000020:00080000:2.0:1787853267.150640:0:21313:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cfbde6d1000), last request at 1787853195 00000020:00000080:2.0:1787853267.150645:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af284e 00000020:00080000:2.0:1787853267.150656:0:21313:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfbde6d1000): rc 0 00000020:00000080:2.0:1787853267.150660:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfbde6d1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787853267.151597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfbc80a9000 for MGC192.168.201.129@tcp 00000020:00000080:0.0:1787853267.151606:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfbc80aa000/e5f0fee8-afcd-4dd4-be87-985382cb1f01 00000020:00000080:0.0:1787853267.151609:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbc80aa000/e5f0fee8-afcd-4dd4-be87-985382cb1f01 for MGC192.168.201.129@tcp 00000020:01000000:0.0:1787853267.151614:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (e5f0fee8-afcd-4dd4-be87-985382cb1f01) 00000020:00000080:0.0:1787853267.151899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6d1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787853267.152960:0:21313:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787853267.152967:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853267.152971:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853267.152977:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853267.153162:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853267.153171:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787853267.153177:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787853267.153181:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853267.153185:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787853267.153192:0:21313:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8cfac3c58800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853267.153198:0:21313:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8cfbf57dcd70) has exports, disconnecting them 00000020:00080000:0.0:1787853267.153203:0:21313:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8cfac3c58800), last request at 1787853195 00000020:00000080:0.0:1787853267.153207:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2863 00000020:00080000:0.0:1787853267.153223:0:21313:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfac3c58800): rc 0 00000020:00000080:0.0:1787853267.153239:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac3c58800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787853267.153608:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3f77800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787853267.153615:0:36:0:(genops.c:885:class_export_put()) final put ffff8cfac253f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787853267.153617:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac253f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787853267.153629:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787853267.153682:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c58800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787853267.157890:0:21313:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787853267.157917:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787853267.157921:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787853267.157930:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853267.157961:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cfac3c5e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787853267.195426:0:20708:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787853267.195573:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787853267.196529:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787853267.196790:0:17123:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cfbfc1bcc00:17123] 1 exiting: rc = 0 00000100:00100000:2.0:1787853267.196905:0:17122:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cfbfc1d2400:17122] 0 exiting: rc = 1 00000100:00100000:1.0:1787853267.197044:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.197324:0:17125:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cfac3c40a00:17125] 1 exiting: rc = 0 00000100:00100000:2.0:1787853267.197397:0:17124:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cfac3c40e00:17124] 0 exiting: rc = 1 00000100:00100000:1.0:1787853267.197924:0:20163:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cfac2c44400:20163] 3 exiting: rc = 0 00000100:00100000:2.0:1787853267.197926:0:17126:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cfac3c40c00:17126] 2 exiting: rc = 0 00000100:00100000:1.0:1787853267.203755:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203767:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203773:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203781:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203787:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203794:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203801:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203806:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203811:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203816:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203822:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203827:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203832:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203838:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203859:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203864:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203869:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203874:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203879:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203885:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203891:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203897:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203902:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203907:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203912:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203917:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203935:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203940:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203947:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203952:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203957:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203962:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203968:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203973:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203978:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203983:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203988:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203994:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.203998:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204004:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204009:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204014:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204019:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204025:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204031:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204036:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204041:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204046:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204052:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204057:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204062:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204080:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204087:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204092:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204097:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204102:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204107:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204112:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204117:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204123:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204282:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204306:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204311:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853267.204316:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787853267.207444:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853267.207579:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787853267.207585:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac3c5f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787853267.207590:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3c5f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787853267.207597:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787853267.207661:0:21313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbde6d4000 1 00000020:00000080:1.0:1787853267.207667:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe2bf4b958af2808 00000020:00000080:1.0:1787853267.207673:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac3cbf800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787853267.207687:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787853267.207699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac3cbf800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787853267.207711:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787853267.207716:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787853267.207720:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8cfbf15819d0) has no exports 00000020:00000080:2.0:1787853267.269414:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853267.269429:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787853267.269435:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfbde6d0800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787853267.269439:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfbde6d0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787853267.269451:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787853267.270624:0:21313:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfbde6d0000 00000020:01000000:2.0:1787853267.270650:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787853267.270657:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853267.270662:0:21313:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787853267.270666:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8cfbe025cd70) has no exports 00000020:00000080:2.0:1787853267.270702:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853267.270710:0:21313:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787853267.270713:0:21313:0:(genops.c:885:class_export_put()) final put ffff8cfac443f800/OSS_uuid 00000020:00000080:2.0:1787853267.270717:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfac443f800/OSS_uuid for OSS 00000020:01000000:2.0:1787853267.270721:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787853267.270810:0:18646:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cfbf71eba00:18646] 1 exiting: rc = 0 00000100:00100000:1.0:1787853267.271018:0:19077:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cfbf890a600:19077] 3 exiting: rc = 0 00000100:00080000:0.0:1787853267.271388:0:17135:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787853267.271569:0:18647:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cfbc863c400:18647] 2 exiting: rc = 0 00000100:00100000:0.0:1787853267.271637:0:18645:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cfbc8772e00:18645] 0 exiting: rc = 1 00000100:00100000:2.0:1787853267.271721:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271729:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271734:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271740:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271771:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271778:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271783:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271789:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271794:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271799:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271804:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271809:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271814:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271819:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271824:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271828:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271833:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271838:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271934:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271941:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271947:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271952:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271958:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271963:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271968:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271974:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271979:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271984:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.271990:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272005:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272010:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272015:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272020:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272026:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272031:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272038:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272044:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272049:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272254:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272260:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272266:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272271:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272276:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272282:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272298:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272304:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272309:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272314:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272320:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272325:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272330:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272336:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272343:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272349:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272354:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272360:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272365:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272371:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272375:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272381:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272386:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272391:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272397:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.272409:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.273979:0:18648:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cfbf71e9e00:18648] 0 exiting: rc = 1 00000100:00100000:1.0:1787853267.279572:0:18649:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cfbf71e9200:18649] 1 exiting: rc = 0 00000100:00100000:0.0:1787853267.280011:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280019:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280025:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280031:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280036:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280042:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280114:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280123:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280275:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280294:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280300:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280305:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280313:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280318:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280324:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280330:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280336:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280341:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280347:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280352:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280356:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280361:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280366:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280371:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280376:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280381:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280386:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280391:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280414:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280419:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280425:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280432:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280438:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280444:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280450:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280455:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280533:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280540:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280546:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280552:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280557:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280562:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280567:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280572:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280578:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280583:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280588:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280593:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280598:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280603:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280608:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280614:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280619:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280625:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280630:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280635:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280640:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280645:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280650:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280655:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280660:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280665:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280671:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.280685:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.282612:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cfbc85b6200:18652] 2 exiting: rc = 0 00000100:00100000:0.0:1787853267.283076:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cfbf71e8400:18651] 1 exiting: rc = 0 00000100:00100000:1.0:1787853267.283523:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cfbf71e9a00:18650] 0 exiting: rc = 1 00000100:00100000:2.0:1787853267.283648:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283656:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283662:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283668:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283673:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283687:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283695:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283702:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283708:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283713:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283719:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283726:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283731:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283737:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283768:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283775:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283780:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283786:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283792:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283799:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283804:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283811:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283816:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283822:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283827:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283832:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.283837:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286589:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286598:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286604:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286610:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286616:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286621:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286627:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286649:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286654:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286660:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286666:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286692:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286699:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286705:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286710:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286716:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286722:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286728:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286733:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286740:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286747:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286752:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286758:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286764:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286769:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286775:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286781:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286787:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286793:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286799:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286805:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286811:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286817:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286823:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286828:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286834:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.286950:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.293402:0:18653:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cfbc85b6e00:18653] 0 exiting: rc = 1 00000100:00100000:1.0:1787853267.293581:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cfbe6929000:18654] 1 exiting: rc = 0 00000100:00100000:2.0:1787853267.293695:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293703:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293710:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293715:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293720:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293736:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293741:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293747:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293752:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293757:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293762:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.293768:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294181:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294188:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294193:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294198:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294203:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294207:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294212:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294217:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294222:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294227:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294233:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294238:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294243:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294248:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294253:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294258:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294263:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294269:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294273:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294279:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294292:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294298:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294303:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294308:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294312:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294317:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294322:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294327:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294341:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294346:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294352:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294357:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294361:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294366:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294371:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294376:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294381:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294386:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294391:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294396:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294402:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294408:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294412:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294418:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294424:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294429:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294435:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294440:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294446:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294451:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294526:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.294535:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853267.295582:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cfbf716e400:18655] 0 exiting: rc = 1 00000100:00100000:1.0:1787853267.295693:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cfbe6928e00:18656] 1 exiting: rc = 0 00000100:00100000:2.0:1787853267.296046:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296386:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296392:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296399:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296405:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296428:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296436:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296442:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296447:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296453:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296524:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296542:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296549:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296556:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296562:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296568:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296575:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296598:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296606:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296612:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296617:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296623:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296628:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296633:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296639:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296644:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296650:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296655:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296660:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296681:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296688:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296694:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296700:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296707:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296712:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296717:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296723:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296728:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296734:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296740:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296746:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296768:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296777:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296782:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296788:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296794:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296807:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296815:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296821:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296827:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296833:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296950:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296959:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296984:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296991:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.296997:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297003:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297009:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297014:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297020:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297027:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297032:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297038:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853267.297170:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787853267.305624:0:21313:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787853288.229560:0:22077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787853299.522476:0:22677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787853299.522483:0:22677:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787853299.522484:0:22677:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787853299.522690:0:22677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfbfbd61000 00000020:01000004:3.0:1787853299.522705:0:22677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787853299.522713:0:22677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787853299.522736:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cfbc81233a0) 00000020:00000080:3.0:1787853299.522750:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787853299.560420:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787853299.561912:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.563309:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.563693:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.563897:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.564091:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.564283:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.564704:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.564941:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.565135:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.565289:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.565439:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.565680:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787853299.565878:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.566268:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.566568:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.566742:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.566927:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.567124:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.567279:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.567444:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.568126:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.568358:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.568580:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.568791:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.569069:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.569267:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.569454:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.569652:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.569864:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.570060:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.570250:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.570442:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.570636:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.570876:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.571143:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.571305:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.571714:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.572127:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.572337:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.572544:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.572757:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.573066:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.573262:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.573463:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787853299.573711:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787853299.581705:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.583662:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.584405:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.584712:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.585104:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.589124:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787853299.592909:0:22677:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1787853299.599169:0:22677:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787853299.599386:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787853299.599394:0:22677:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787853299.599406:0:22677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2cb5 00000020:01000004:3.0:1787853299.599414:0:22677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787853299.599419:0:22677:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787853299.599423:0:22677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfbfbd61000 from MGS 00000020:01000004:3.0:1787853299.599427:0:22677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787853299.599436:0:22677:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cfbc81219d0) 00000020:00000080:3.0:1787853299.599448:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787853299.599506:0:22677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfbfbd61000 from MGS, refs=2 00080000:01000000:3.0:1787853299.599511:0:22677:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853299.599516:0:22677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2cc3 00000100:00100000:3.0:1787853299.599609:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787853299.599756:0:22677:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787853299.599762:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787853299.610180:0:22677:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787853299.611652:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787853299.612364:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853299.612749:0:22677:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787853299.612761:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787853299.613483:0:22677:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787853299.613491:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787853299.615331:0:22677:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787853299.615343:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787853299.616182:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853299.616186:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853299.616188:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853299.616795:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853299.616798:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853299.616800:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853299.617391:0:22677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787853299.623418:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787853299.633546:0:22677:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787853299.637375:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787853299.637456:0:22677:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787853299.637604:0:22677:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787853299.638209:0:22677:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787853299.646919:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853299.647128:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787853299.647136:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787853299.647980:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787853299.647989:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787853299.650115:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787853299.650177:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787853299.651649:0:22694:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787853299.651727:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787853299.651752:0:22677:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:1.0:1787853299.651754:0:22677:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787853299.651801:0:22677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:1.0:1787853299.651816:0:22677:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff8cfbf7154d70) 00000020:00000080:1.0:1787853299.651837:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787853299.652455:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfac55f1800@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1787853299.652813:0:22677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:1.0:1787853299.652820:0:22677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787853299.657218:0:22695:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787853299.657312:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid d1465330-a4cf-4e7d-ab3b-959371f1d7aa) 00000020:00000080:1.0:1787853299.657337:0:22677:0:(genops.c:1385:class_connect()) connect: client d1465330-a4cf-4e7d-ab3b-959371f1d7aa, cookie 0xe2bf4b958af2cd1 00000100:00080000:1.0:1787853299.657350:0:22677:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853299.657356:0:22677:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff8cfac55f1800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853299.657390:0:22677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd91a40 x1874699491699456/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853299.657421:0:22677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d1465330-a4cf-4e7d-ab3b-959371f1d7aa->MGS 00000100:00100000:3.0:1787853299.657592:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3642:1874699491699456:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787853299.657660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787853299.657745:0:22677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787853299.657750:0:22677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787853299.657763:0:22677:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cfbf71533a0) 00000020:00000080:1.0:1787853299.657774:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787853299.659655:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491699456 00000100:00100000:0.0:1787853299.659668:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491699456 00000100:00100000:0.0:1787853299.659708:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853299.659716:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1874699491699456:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787853299.659753:0:22691:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from d1465330-a4cf-4e7d-ab3b-959371f1d7aa@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:0.0:1787853299.659779:0:22691:0:(genops.c:1385:class_connect()) connect: client d1465330-a4cf-4e7d-ab3b-959371f1d7aa, cookie 0xe2bf4b958af2cdf 00000100:00080000:0.0:1787853299.662010:0:22691:0:(import.c:65:import_set_state_nolock()) ffff8cfbfbe8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853299.662101:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:3642:x1874699491699456:12345-0@lo:250:mount.lustre.0 Request processed in 2384us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853299.662110:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853299.662174:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787853299.662182:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1787853299.662189:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787853299.662193:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787853299.662196:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac55f1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787853299.662199:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787853299.662208:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787853299.662213:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3642:1874699491699456:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787853299.674175:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853299.674392:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787853299.674398:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787853299.675464:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787853299.675477:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787853299.676000:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787853299.676007:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787853299.677450:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853299.678893:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787853299.678901:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787853299.679457:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787853299.679465:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787853299.741045:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853299.741240:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787853299.741246:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787853299.744696:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787853299.744708:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787853299.745392:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853299.745673:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787853299.745679:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787853299.746215:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787853299.746222:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787853299.746837:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853299.747049:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787853299.747056:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787853299.749330:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787853299.749341:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787853299.763964:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853299.764144:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787853299.764156:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787853299.772204:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787853299.775004:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787853299.813343:0:22677:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853299.816733:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787853299.816746:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787853299.828248:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853299.828269:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787853299.831053:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787853299.831075:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787853299.832939:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787853299.832979:0:22677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787853299.832985:0:22677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787853299.833104:0:22677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787853299.833138:0:22677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787853299.833142:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787853299.833144:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853299.833145:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853299.833146:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853299.833147:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853299.833149:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853299.833150:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853299.833152:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853299.833154:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853299.833155:0:22677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787853299.833157:0:22677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787853299.833159:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787853299.833165:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853299.833166:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853299.833167:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853299.833168:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853299.833169:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853299.833170:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853299.833171:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853299.833171:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853299.833172:0:22677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787853299.833200:0:22677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787853299.833220:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699584:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787853299.833321:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.833367:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853299.833470:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491699584 00000100:00100000:1.0:1787853299.833477:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491699584 00000100:00100000:1.0:1787853299.833558:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853299.833568:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:22677:x1874699491699584:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787853299.833618:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787853299.833621:0:22693:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787853299.833624:0:22693:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787853299.834812:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787853299.838860:0:22693:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787853299.840520:0:22715:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787853299.840525:0:22715:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787853299.840528:0:22715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787853299.840530:0:22715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787853299.840758:0:22715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787853299.840975:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853299.840985:0:22693:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787853299.844597:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699584:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787853299.844617:0:22677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787853299.844621:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787853299.844622:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853299.844624:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853299.844625:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853299.844626:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853299.844627:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853299.844628:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853299.844630:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853299.844631:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853299.844633:0:22677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787853299.844651:0:22677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfbfbd61000 from lustre-MDT0000 10000000:01000000:3.0:1787853299.844681:0:22677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787853299.844684:0:22677:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787853299.844687:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cfbf7154d70 10000000:01000000:3.0:1787853299.844691:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853299.844699:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfbf7154d70 from 1 10000000:01000000:3.0:1787853299.844702:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787853299.844752:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.844778:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.844787:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853299.844806:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853299.844866:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.844908:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853299.844974:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491699712 00000100:00100000:0.0:1787853299.844980:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491699712 00000100:00100000:0.0:1787853299.845024:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853299.845032:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+6:22677:x1874699491699712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853299.845044:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853299.845058:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2000/0xe2bf4b958af2ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2ce6 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853299.845080:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2000/0xe2bf4b958af2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2ce6 expref: 7 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853299.845090:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2000/0xe2bf4b958af2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2ce6 expref: 7 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853299.845098:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2000, rc 0) 00000100:00100000:0.0:1787853299.845137:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+7:22677:x1874699491699712:12345-0@lo:101:mount.lustre.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853299.845144:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853299.845267:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853299.845280:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.845289:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853299.845353:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853299.845377:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.845403:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853299.845465:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:22677:x1874699491699584:12345-0@lo:253:mount.lustre.0 Request processed in 10904us (11150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853299.845475:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853299.845592:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491699840 00000100:00100000:1.0:1787853299.845597:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491699840 00000100:00100000:1.0:1787853299.845627:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853299.845634:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+6:22677:x1874699491699840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853299.845763:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+6:22677:x1874699491699840:12345-0@lo:501:mount.lustre.0 Request processed in 129us (383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853299.845770:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853299.845939:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699840:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787853299.845969:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787853299.845984:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.845992:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853299.846011:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfbfbd61000 10000000:01000000:3.0:1787853299.846014:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787853299.846017:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfbfbd61000 10000000:01000000:3.0:1787853299.846020:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787853299.846023:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfbfbd61000 from 1 10000000:01000000:3.0:1787853299.846025:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787853299.846044:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.846050:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.846057:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853299.846070:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853299.846098:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.846121:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853299.846188:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491699968 00000100:00100000:2.0:1787853299.846192:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491699968 00000100:00100000:2.0:1787853299.846224:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853299.846230:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+6:22677:x1874699491699968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853299.846238:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853299.846249:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794200/0xe2bf4b958af2cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2cf4 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.846264:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794200/0xe2bf4b958af2cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2cf4 expref: 7 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.846272:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794200/0xe2bf4b958af2cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2cf4 expref: 7 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.846279:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794200, rc 0) 00000100:00100000:2.0:1787853299.846307:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+7:22677:x1874699491699968:12345-0@lo:101:mount.lustre.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853299.846313:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853299.847218:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491699968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853299.847237:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2cfb expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.847246:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2cfb expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853299.847261:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787853299.847277:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2cfb expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.847294:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb800/0xe2bf4b958af2cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2cfb expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853299.847301:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787853299.847305:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853299.847311:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfbfbd61000 10000000:01000000:3.0:1787853299.847313:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787853299.847316:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787853299.847319:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787853299.847339:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.847346:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.847353:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853299.847366:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853299.847403:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.847442:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853299.847503:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700096 00000100:00100000:2.0:1787853299.847509:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700096 00000100:00100000:2.0:1787853299.847553:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853299.847560:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+7:22677:x1874699491700096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853299.847569:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853299.847579:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4795c00/0xe2bf4b958af2d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2d02 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.847596:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4795c00/0xe2bf4b958af2d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2d02 expref: 8 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.847604:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4795c00/0xe2bf4b958af2d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2d02 expref: 8 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853299.847618:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4795c00, rc 0) 00000100:00100000:2.0:1787853299.847647:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+8:22677:x1874699491700096:12345-0@lo:101:mount.lustre.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853299.847653:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853299.848633:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853299.848651:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d09 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853299.848661:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2d09 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853299.848753:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853299.848791:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.848816:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853299.848891:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700224 00000100:00100000:2.0:1787853299.848897:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700224 00000100:00100000:2.0:1787853299.848927:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853299.848934:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+8:22677:x1874699491700224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853299.849107:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22677:x1874699491700224:12345-0@lo:501:mount.lustre.0 Request processed in 173us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853299.849114:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787853299.849339:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853299.849365:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853299.849406:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853299.849445:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853299.849505:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700352 00000100:00100000:0.0:1787853299.849509:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700352 00000100:00100000:0.0:1787853299.849540:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853299.849547:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22677:x1874699491700352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853299.850631:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22677:x1874699491700352:12345-0@lo:503:mount.lustre.0 Request processed in 1079us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853299.850647:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853299.851353:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491700352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853299.853699:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22716:1874699491700480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853299.853800:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853299.856013:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcbdf7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853299.858164:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700480 00000100:00100000:1.0:1787853299.858177:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700480 00000100:00100000:1.0:1787853299.858280:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853299.858290:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22716:x1874699491700480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853299.859224:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22716:x1874699491700480:12345-0@lo:502:llog_process_th.0 Request processed in 932us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853299.859234:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853299.859353:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22716:1874699491700480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853299.859386:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853299.859397:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853299.859399:0:22716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787853299.859404:0:22716:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787853299.859406:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853299.859420:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cfbf57d8000) 00000020:00000080:0.0:1787853299.859434:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787853299.859438:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787853299.859702:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787853299.859709:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d17 00000020:00000080:0.0:1787853299.860086:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787853299.860091:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853299.860095:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853299.860096:0:22716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787853299.860099:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853299.860103:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853299.860105:0:22716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787853299.860108:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853299.860115:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cfbf57db3a0) 00000020:00000080:0.0:1787853299.860127:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787853299.860130:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787853299.860133:0:22716:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787853299.860136:0:22716:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787853299.860142:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787853299.860194:0:22716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfbfbd61000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787853299.860206:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cfbf57dcd70) 00000020:00000080:0.0:1787853299.860214:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787853299.860275:0:22716:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787853299.860284:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2d2c 00000020:00000080:0.0:1787853299.860374:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787853299.860380:0:22716:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787853299.860385:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe2bf4b958af2d33 00080000:01000000:0.0:1787853299.860390:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787853299.860393:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d3a 00010000:00010000:3.0:1787853300.020139:0:22716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787853300.021724:0:22716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:3.0:1787853300.022183:0:22716:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787853300.022818:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cfbc8120000) 00000020:00000080:3.0:1787853300.022836:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787853300.022952:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787853300.022959:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d48 00000020:00000080:3.0:1787853300.025949:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787853300.031472:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe2bf4b958af2d4f 00000020:00000080:0.0:1787853300.034856:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787853300.034871:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.034878:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.034880:0:22716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787853300.034883:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787853300.034886:0:22716:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787853300.034887:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787853300.034889:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787853300.034890:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787853300.034892:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.034893:0:22716:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787853300.034896:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.034900:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.034901:0:22716:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787853300.034906:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787853300.034957:0:22716:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787853300.034972:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.034975:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.034976:0:22716:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787853300.034979:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.034981:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.034983:0:22716:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787853300.034985:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787853300.034997:0:22716:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:00000080:0.0:1787853300.035028:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853300.035044:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8cfbf57d99d0) 00000020:00000080:0.0:1787853300.035061:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787853300.035066:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787853300.035138:0:22716:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787853300.035144:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787853300.035150:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d5d 00010000:00080000:0.0:1787853300.035183:0:22716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbc8b82800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1787853300.039388:0:22716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787853300.048234:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853300.048249:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787853300.048289:0:22716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787853300.048309:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2d64 00000100:00080000:2.0:1787853300.048319:0:22716:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853300.048325:0:22716:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfbc8b82800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853300.048362:0:22716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbf60b2d00 x1874699491700608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853300.048390:0:22716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787853300.048445:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853300.048448:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853300.048450:0:22716:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787853300.048453:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787853300.048456:0:22716:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787853300.048458:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853300.048459:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853300.048468:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787853300.048471:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853300.048473:0:22716:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787853300.048476:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1787853300.048582:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787853300.048651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787853300.048736:0:22716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787853300.048741:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853300.048743:0:22716:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787853300.048747:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787853300.048751:0:22716:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1787853300.048770:0:22716:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787853300.048773:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853300.048786:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cfbf15819d0) 00000020:00000080:2.0:1787853300.048797:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787853300.048801:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787853300.048895:0:22716:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787853300.048901:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787853300.048907:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d72 00010000:00080000:2.0:1787853300.048946:0:22716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbd2304800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1787853300.049135:0:22716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787853300.049871:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700608 00000100:00100000:3.0:1787853300.049880:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700608 00000100:00100000:3.0:1787853300.049914:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853300.049921:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1874699491700608:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787853300.049937:0:22703:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853300.050569:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491700736:0@lo:400:kworker.0 00000100:00100000:1.0:1787853300.050636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853300.050690:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491700736 00000100:00100000:1.0:1787853300.050695:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491700736 00000100:00100000:1.0:1787853300.050742:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853300.050750:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:3643:x1874699491700736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853300.050796:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:3643:x1874699491700736:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853300.050804:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853300.050868:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491700736:0@lo:400:kworker.0 00000040:01000000:2.0:1787853300.052143:0:22716:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787853300.052710:0:22716:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787853300.056561:0:22716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853300.056767:0:22716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787853300.070355:0:22716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:0.0:1787853300.072221:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1874699491700608:12345-0@lo:38:llog_process_th.0 Request processed in 22293us (23564us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853300.072257:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787853300.073779:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853300.073789:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787853300.073794:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700608:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787853300.074336:0:22722:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787853300.074341:0:22722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787853300.079356:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853300.079373:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787853300.079418:0:22716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787853300.079441:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2d79 00000100:00080000:1.0:1787853300.079453:0:22716:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853300.079459:0:22716:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfbd2304800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853300.079526:0:22716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd921c0 x1874699491700864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853300.079583:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700864:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787853300.079647:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491700864 offset 0 length 520: 4 00000100:00080000:1.0:1787853300.079704:0:22716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787853300.079913:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853300.079924:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.079926:0:22716:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787853300.079930:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787853300.079933:0:22716:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787853300.079935:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853300.079936:0:22716:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853300.079938:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787853300.079940:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.079941:0:22716:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787853300.079944:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787853300.079948:0:22716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787853300.079951:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.079953:0:22716:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787853300.079956:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787853300.079960:0:22716:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:1.0:1787853300.079981:0:22716:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787853300.079984:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853300.079997:0:22716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cfbf7150000) 00000020:00000080:1.0:1787853300.080009:0:22716:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787853300.080015:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787853300.080077:0:22716:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787853300.080083:0:22716:0:(osd_handler.c:8928:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787853300.080088:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2bf4b958af2d87 00010000:00080000:1.0:1787853300.080126:0:22716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbfdcb2800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1787853300.080336:0:22716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787853300.080404:0:22716:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787853300.080419:0:22716:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787853300.083648:0:22716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853300.084156:0:22716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787853300.084314:0:22716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1787853300.086310:0:22724:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787853300.086316:0:22724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787853300.087249:0:22716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853300.087266:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787853300.087303:0:22716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787853300.087321:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2d8e 00000100:00080000:1.0:1787853300.087331:0:22716:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853300.087337:0:22716:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfbfdcb2800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853300.087373:0:22716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd91e00 x1874699491700992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853300.087442:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700992:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787853300.087505:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491700992 offset 0 length 520: 4 00000100:00080000:1.0:1787853300.087564:0:22716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787853300.087619:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853300.087623:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.087625:0:22716:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787853300.087629:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853300.087633:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.087634:0:22716:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853300.087638:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853300.087640:0:22716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853300.087642:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853300.087644:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.087645:0:22716:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787853300.087647:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853300.087649:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.087651:0:22716:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853300.087654:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787853300.087684:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22716:1874699491701120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853300.087752:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853300.087786:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701120 00000100:00100000:1.0:1787853300.087792:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701120 00000100:00100000:1.0:1787853300.087831:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853300.087839:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22716:x1874699491701120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853300.087965:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22716:x1874699491701120:12345-0@lo:502:llog_process_th.0 Request processed in 126us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853300.087977:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853300.088015:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf6325840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853300.088032:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22716:1874699491701120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853300.088055:0:22716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853300.088058:0:22716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853300.088060:0:22716:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853300.088063:0:22716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787853300.088293:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787853300.088317:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787853300.088337:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d09 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.088348:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca600/0xe2bf4b958af2d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d09 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853300.088356:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfbfbd61000 from 1 10000000:01000000:3.0:1787853300.088359:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853300.088383:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.088391:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.088400:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.088414:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853300.088452:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.088482:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853300.088736:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701248 00000100:00100000:1.0:1787853300.088740:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701248 00000100:00100000:1.0:1787853300.088915:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853300.088924:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+9:22677:x1874699491701248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853300.088934:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853300.088950:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2d95 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853300.088971:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 10 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853300.088981:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 10 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853300.088990:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240200, rc 0) 00000100:00100000:1.0:1787853300.089029:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+10:22677:x1874699491701248:12345-0@lo:101:mount.lustre.0 Request processed in 107us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853300.089035:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787853300.089088:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853300.089100:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.089119:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.089616:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701376:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787853300.089656:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.100547:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.100720:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701376 00000100:00100000:2.0:1787853300.100729:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701376 00000100:00100000:1.0:1787853300.104707:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853300.104732:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+10:22677:x1874699491701376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787853300.104779:0:22692:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787853300.104785:0:22692:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787853300.104936:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+10:22677:x1874699491701376:12345-0@lo:256:mount.lustre.0 Request processed in 208us (15279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853300.104943:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787853300.105042:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701376:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787853300.105705:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787853300.105737:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.105750:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853300.105760:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfbfbd61000 from 1 10000000:01000000:3.0:1787853300.105762:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853300.105794:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.105802:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.105811:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.105829:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853300.105898:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.105997:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.106117:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701504 00000100:00100000:2.0:1787853300.106125:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701504 00000100:00100000:2.0:1787853300.106165:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853300.106172:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+10:22677:x1874699491701504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853300.106183:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853300.106194:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2da3 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.106219:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 11 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.106229:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 11 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.106237:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794a00, rc 0) 00000100:00100000:2.0:1787853300.106274:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491701504:12345-0@lo:101:mount.lustre.0 Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.106280:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853300.106707:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853300.106730:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.106738:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.106797:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853300.106823:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853300.106930:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701632 00000100:00100000:2.0:1787853300.106934:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701632 00000100:00100000:2.0:1787853300.106967:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853300.106974:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491701632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853300.107092:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491701632:12345-0@lo:501:mount.lustre.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.107099:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853300.109618:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853300.109654:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853300.109721:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853300.109793:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853300.109812:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf6325f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.109890:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701760 00000100:00100000:2.0:1787853300.109896:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701760 00000100:00100000:2.0:1787853300.109943:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853300.109952:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491701760:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853300.110065:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491701760:12345-0@lo:503:mount.lustre.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.110073:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787853300.110558:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd930c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491701760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853300.111005:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22726:1874699491701888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853300.111046:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853300.111080:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd2191240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.111134:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491701888 00000100:00100000:2.0:1787853300.111140:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491701888 00000100:00100000:2.0:1787853300.111176:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853300.111183:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22726:x1874699491701888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853300.111613:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22726:x1874699491701888:12345-0@lo:502:llog_process_th.0 Request processed in 428us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.111622:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787853300.111703:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22726:1874699491701888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853300.111735:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.111744:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111747:0:22726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853300.111754:0:22726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfbfbd61000 00000020:00000080:0.0:1787853300.111757:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853300.111765:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.111774:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111775:0:22726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787853300.111778:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.111780:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111782:0:22726:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787853300.111785:0:22726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfbfbd61000 00000020:00000080:0.0:1787853300.111787:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853300.111877:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.111881:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111883:0:22726:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787853300.111885:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.111887:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111889:0:22726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853300.111892:0:22726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfbfbd61000 00000020:00000080:0.0:1787853300.111894:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853300.111910:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.111913:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111914:0:22726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853300.111917:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853300.111919:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.111920:0:22726:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787853300.111923:0:22726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfbfbd61000 00000020:00000080:0.0:1787853300.111925:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853300.111954:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22726:1874699491702016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853300.111987:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853300.112008:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702016 00000100:00100000:0.0:1787853300.112012:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702016 00000100:00100000:0.0:1787853300.112033:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853300.112040:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22726:x1874699491702016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853300.112103:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22726:x1874699491702016:12345-0@lo:502:llog_process_th.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853300.112118:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853300.112142:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd2191240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853300.112154:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22726:1874699491702016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853300.112170:0:22726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853300.112173:0:22726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853300.112174:0:22726:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787853300.112177:0:22726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787853300.112334:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787853300.112358:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853300.112380:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.112391:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853300.112437:0:22677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787853300.112440:0:22677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfbfbd61000 10000000:01000000:3.0:1787853300.112443:0:22677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfbfbd61000 10000000:01000000:3.0:1787853300.112447:0:22677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853300.112452:0:22677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfbfbd61000 from 1 10000000:01000000:3.0:1787853300.112454:0:22677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853300.112485:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.112493:0:22677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.112509:0:22677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.112522:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853300.112551:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.112572:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853300.113586:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702144 00000100:00100000:0.0:1787853300.113593:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702144 00000100:00100000:0.0:1787853300.113622:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787853300.113630:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22677:x1874699491702144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853300.113641:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853300.113655:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2e00/0xe2bf4b958af2db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2db1 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.113679:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2e00/0xe2bf4b958af2db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2db1 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.113689:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2e00/0xe2bf4b958af2db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2db1 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.113697:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2e00, rc 0) 00000100:00100000:0.0:1787853300.113752:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491702144:12345-0@lo:101:mount.lustre.0 Request processed in 123us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853300.113757:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853300.114671:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853300.114693:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2db8 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.114704:0:22677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2db8 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.114789:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853300.114829:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.114897:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853300.115089:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702272 00000100:00100000:0.0:1787853300.115095:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702272 00000100:00100000:0.0:1787853300.115136:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853300.115157:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491702272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853300.115272:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491702272:12345-0@lo:501:mount.lustre.0 Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853300.115280:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787853300.116596:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853300.116642:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853300.116695:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.116755:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.117584:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702400 00000100:00100000:2.0:1787853300.117592:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702400 00000100:00100000:2.0:1787853300.117647:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853300.117656:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491702400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853300.117789:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491702400:12345-0@lo:503:mount.lustre.0 Request processed in 134us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.117796:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853300.121661:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491702400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853300.122724:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853300.122815:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.122888:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5b2e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.122973:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702528 00000100:00100000:2.0:1787853300.122981:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702528 00000100:00100000:2.0:1787853300.123025:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853300.123034:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853300.123150:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702528:12345-0@lo:502:llog_process_th.0 Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.123158:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853300.123359:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702528:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787853300.123420:0:22728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787853300.123435:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cfbc8124d70) 00000020:00000080:3.0:1787853300.123454:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787853300.126205:0:22728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfbfbd61000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787853300.126215:0:22728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfbfbd61000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787853300.126218:0:22728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfbfbd61000 4 00010000:00080000:3.0:1787853300.126253:0:22728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbd8c90000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1787853300.139376:0:22728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787853300.139592:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787853300.140776:0:22728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787853300.140795:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe2bf4b958af2dc6 00000100:00080000:3.0:1787853300.140807:0:22728:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853300.140813:0:22728:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfbd8c90000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853300.140876:0:22728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4753840 x1874699491702656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853300.140918:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491702656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853300.140993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853300.141035:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702656 00000100:00100000:1.0:1787853300.141042:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702656 00000100:00080000:3.0:1787853300.141054:0:22728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787853300.141075:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853300.141083:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1874699491702656:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787853300.141147:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1874699491702656:12345-0@lo:38:llog_process_th.0 Request processed in 63us (153us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787853300.141154:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853300.141454:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853300.141462:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd8c90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853300.141466:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787853300.141470:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491702656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853300.149339:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853300.149420:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853300.149474:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc9f1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853300.149559:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702784 00000100:00100000:3.0:1787853300.149566:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702784 00000100:00100000:3.0:1787853300.149616:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853300.149624:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853300.149749:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702784:12345-0@lo:502:llog_process_th.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853300.149756:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853300.149836:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853300.149896:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853300.149924:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853300.149943:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd5a31300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853300.149986:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491702912 00000100:00100000:3.0:1787853300.149989:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491702912 00000100:00100000:3.0:1787853300.150014:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853300.150020:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853300.150075:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22728:x1874699491702912:12345-0@lo:502:llog_process_th.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853300.150082:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853300.150140:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22728:1874699491702912:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787853300.150157:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787853300.150385:0:22677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787853300.150406:0:22677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787853300.150486:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2db8 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.150497:0:22677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca800/0xe2bf4b958af2db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2db8 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787853300.150545:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787853300.150547:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853300.150548:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853300.150550:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853300.150551:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853300.150552:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853300.150554:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853300.150555:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853300.150557:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853300.150559:0:22677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853300.150562:0:22677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787853300.150564:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787853300.150565:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853300.150570:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853300.150571:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853300.150572:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853300.150573:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853300.150574:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853300.150575:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853300.150576:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853300.150577:0:22677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853300.150589:0:22677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787853300.150598:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491703040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787853300.150625:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.150683:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb7699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.150741:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703040 00000100:00100000:2.0:1787853300.150745:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703040 00000100:00100000:2.0:1787853300.150802:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853300.150809:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491703040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853300.150829:0:22692:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787853300.150878:0:22692:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787853300.157758:0:22692:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787853300.157781:0:22692:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787853300.158115:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22677:x1874699491703040:12345-0@lo:253:mount.lustre.0 Request processed in 7302us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.158127:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:3.0:1787853300.158208:0:22714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853300.158213:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1787853300.158226:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22677:1874699491703040:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1787853300.158232:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853300.158238:0:22677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787853300.158241:0:22677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853300.158243:0:22677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853300.158244:0:22677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853300.158246:0:22677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:3.0:1787853300.158247:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 11 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787853300.158247:0:22677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853300.158249:0:22677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853300.158250:0:22677:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853300.158252:0:22677:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853300.158253:0:22677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853300.158254:0:22677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1787853300.158255:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1787853300.158284:0:22677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787853300.158287:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 11 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158300:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 11 pid: 22693 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853300.158313:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491703168:0@lo:104: 00000100:00100000:3.0:1787853300.158349:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853300.158393:0:22714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb769780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853300.158451:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703168 00000100:00100000:2.0:1787853300.158457:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703168 00000100:00100000:2.0:1787853300.158507:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853300.158516:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491703168:12345-0@lo:104: 00010000:00010000:2.0:1787853300.158528:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.158571:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853300.158577:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491703168:12345-0@lo:104: Request processed in 62us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853300.158583:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853300.158607:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491703168:0@lo:104: 00010000:00010000:2.0:1787853300.158621:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158697:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853300.158709:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158726:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfccca200 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:3.0:1787853300.158730:0:22687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158738:0:22687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853300.158746:0:22687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853300.158752:0:22687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853300.158788:0:22687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158795:0:22687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853300.158818:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158826:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2d95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2d9c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853300.158861:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853300.158863:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853300.158865:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853300.158876:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491703296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853300.158903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853300.159197:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703296 00000100:00100000:0.0:1787853300.159202:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703296 00010000:00010000:0.0:1787853300.159221:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 12 pid: 22693 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853300.159253:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853300.159260:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:3644:x1874699491703296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853300.159271:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853300.159276:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 12 pid: 22693 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159287:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 12 pid: 22693 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159301:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240200/0xe2bf4b958af2d9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2d95 expref: 12 pid: 22693 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159312:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159321:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853300.159334:0:22683:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001121754s 00010000:00010000:0.0:1787853300.159338:0:22683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159358:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159365:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159372:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159378:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccbe00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853300.159382:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159390:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159405:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853300.159415:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853300.159446:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:3644:x1874699491703296:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853300.159453:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853300.164854:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491703296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853300.167887:0:22714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.167905:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853300.167913:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dcd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787853300.193449:0:22677:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1787853300.194869:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787853300.195264:0:22739:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:0.0:1787853300.195310:0:22738:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1787853300.195315:0:22738:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1787853300.195467:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787853300.197958:0:22739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853300.200597:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787853300.200685:0:22739:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1787853300.201210:0:22740:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8cfbf60b2940 x1874699491703424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853300.201220:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00000040:01000000:3.0:1787853300.201456:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787853300.201486:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787853300.201965:0:22677:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787853300.202034:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787853300.202071:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853300.202802:0:22677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787853300.203597:0:22677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787853300.203644:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787853300.204392:0:22677:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787853300.204989:0:22677:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1787853300.206667:0:22677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787853300.208071:0:22677:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787853300.208106:0:22677:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9b8f00d4b988 00100000:10000000:1.0:1787853300.208114:0:22677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787853300.209125:0:22677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787853300.209142:0:22677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787853300.209165:0:22677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787853300.209192:0:22677:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787853300.209925:0:22677:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787853300.210117:0:22677:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787853300.632185:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853301.201910:0:22734:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787853301.201919:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853301.210203:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787853301.210216:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787853301.266673:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 10000000:01000000:3.0:1787853301.285866:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787853301.285874:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfbfbd61000 from 11 10000000:01000000:3.0:1787853301.285879:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853301.285923:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853301.285935:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853301.285947:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853301.285971:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491703552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853301.286034:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853301.286082:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853301.286151:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703552 00000100:00100000:0.0:1787853301.286159:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703552 00000100:00100000:0.0:1787853301.286205:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853301.286213:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+11:22695:x1874699491703552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853301.286226:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853301.286238:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2dd4 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853301.286260:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853301.286271:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853301.286280:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2a00, rc 0) 00000100:00100000:0.0:1787853301.286312:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22695:x1874699491703552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853301.286318:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853301.286392:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491703552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853301.286405:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853301.286413:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853301.286938:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491703680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787853301.286975:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853301.288930:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853301.289274:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703680 00000100:00100000:0.0:1787853301.289282:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703680 00000100:00100000:0.0:1787853301.289337:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853301.289345:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22695:x1874699491703680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787853301.289379:0:22692:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787853301.289393:0:22692:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787853301.289396:0:22692:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787853301.289632:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:22695:x1874699491703680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 287us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853301.289641:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853301.289725:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491703680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787853301.289779:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787853301.289788:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853301.289799:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853301.648026:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853302.224619:0:22734:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787853302.224629:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853302.224759:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1787853302.224797:0:22734:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853302.224963:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787853302.294709:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787853302.673031:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853303.316410:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853303.696813:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853304.340151:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787853304.720766:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853304.929317:0:22983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787853305.363938:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00000100:00100000:3.0:1787853305.490911:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491703808:0@lo:400:kworker.0 00000100:00100000:3.0:1787853305.490988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853305.491104:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703808 00000100:00100000:2.0:1787853305.491126:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703808 00000100:00080000:0.0:1787853305.491170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787853305.491175:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787853305.491179:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787853305.491180:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787853305.491188:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1787853305.491194:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787853305.491195:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:3645:x1874699491703808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787853305.491203:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfbc8b82800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853305.491230:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32de00 x1874699491703936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853305.491260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853305.491265:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853305.491267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853305.491270:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853305.491273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787853305.491276:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787853305.491278:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfbd8c90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853305.491295:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfbd8c90000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853305.491310:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32d2c0 x1874699491704064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853305.491343:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491703936:0@lo:38:kworker.0 00000100:00100000:0.0:1787853305.491373:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853305.491391:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491704064:0@lo:38:kworker.0 00000100:00100000:0.0:1787853305.491413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853305.492084:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703936 00000100:00100000:0.0:1787853305.492090:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703936 00000100:00100000:0.0:1787853305.492114:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853305.492120:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491703936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787853305.492136:0:22704:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787853305.492177:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491703936:12345-0@lo:38:kworker.0 Request processed in 55us (802us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853305.492192:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787853305.492237:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853305.492241:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787853305.492256:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491703936:0@lo:38:kworker.0 00000100:00100000:0.0:1787853305.494700:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704064 00000100:00100000:0.0:1787853305.494713:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704064 00000100:00100000:2.0:1787853305.496543:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:3645:x1874699491703808:12345-0@lo:400:kworker.0 Request processed in 5343us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853305.496546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491703808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853305.496564:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853305.496776:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853305.496784:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491704064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787853305.496813:0:22700:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:0.0:1787853305.496863:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe2bf4b958af2de2 00000004:00100000:0.0:1787853305.496878:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787853305.497026:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8f89000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853305.497105:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874699491704064:12345-0@lo:38:kworker.0 Request processed in 321us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853305.497113:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787853305.499771:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfbfc32d2c0 x1874699491704064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853305.499793:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787853305.499801:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787853305.499806:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787853305.499810:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd8c90000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787853305.499815:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874699491704064:0@lo:38:kworker.0 00010000:00010000:0.0:1787853305.745006:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787853306.106754:0:23035:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787853306.106970:0:23035:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787853306.391550:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853306.771232:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787853307.106218:0:23085:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787853307.106494:0:23085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787853307.407902:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787853307.805751:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853308.436624:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853308.818701:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853309.455914:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853309.848367:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853310.481067:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00000100:00080000:1.0:1787853310.608066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787853310.608074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787853310.608077:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853310.608086:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1787853310.608092:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787853310.608099:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfbc8b82800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853310.608122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd912c0 x1874699491704320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853310.608137:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853310.608141:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853310.608144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853310.608146:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787853310.608215:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853310.608232:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491704192:0@lo:400:kworker.0 00000100:00100000:0.0:1787853310.608325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853310.608395:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491704448:0@lo:400:kworker.0 00000100:00100000:0.0:1787853310.608424:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853310.608476:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704448 00000100:00100000:0.0:1787853310.608483:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704448 00000100:00100000:0.0:1787853310.608522:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853310.608541:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491704448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853310.608590:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491704448:12345-0@lo:400:kworker.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853310.608597:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787853310.608637:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfbfbd93c00 x1874699491704448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853310.608650:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491704448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853310.608810:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853300/real 1787853300] req@ffff8cfbfbd91e00 x1874699491700992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853310 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853310.608828:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd91e00 x1874699491700992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853310 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853310.608837:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853300/real 1787853300] req@ffff8cfbfbd921c0 x1874699491700864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853310 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853310.608900:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd921c0 x1874699491700864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853310 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853310.608914:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704320:0@lo:38:kworker.0 00000100:00100000:3.0:1787853310.608977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853310.609000:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853310.609011:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853310.609015:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700992:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787853310.609020:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853310.609024:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853310.609027:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491700864:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787853310.609115:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704192 00000100:00100000:1.0:1787853310.609120:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704192 00000100:00100000:1.0:1787853310.609160:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787853310.609169:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:3645:x1874699491704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853310.609211:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:3645:x1874699491704192:12345-0@lo:400:kworker.0 Request processed in 44us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853310.609217:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787853310.609246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853310.609250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787853310.609252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853310.609256:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1787853310.609267:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853310.609272:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfbd2304800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853310.609289:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd92d00 x1874699491704576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853310.609303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853310.609306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853310.609308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853310.609311:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1787853310.609314:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853310.609317:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfbfdcb2800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853310.609329:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd92940 x1874699491704704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853310.609506:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704576:0@lo:8:kworker.0 00000400:00000100:3.0:1787853310.609542:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491704576 offset 0 length 520: 4 00000100:00100000:3.0:1787853310.609568:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704704:0@lo:8:kworker.0 00000400:00000100:3.0:1787853310.609591:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491704704 offset 0 length 520: 4 00000100:00100000:0.0:1787853310.609718:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704320 00000100:00100000:0.0:1787853310.609723:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704320 00000100:00100000:0.0:1787853310.609753:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853310.609757:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491704320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787853310.609774:0:22704:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787853310.609819:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491704320:12345-0@lo:38:kworker.0 Request processed in 60us (840us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853310.609825:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853310.609871:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491704192:0@lo:400:kworker.0 00000100:00080000:3.0:1787853310.617093:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853310.617106:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787853310.617111:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704320:0@lo:38:kworker.0 00010000:00010000:1.0:1787853310.866052:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853311.506225:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853311.894030:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853312.467000:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787853312.528983:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:2.0:1787853312.914224:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853313.553705:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787853313.936995:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853314.059789:0:23430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787853314.059794:0:23430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787853314.059796:0:23430:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787853314.059937:0:23430:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfac39d1000 00000020:01000004:0.0:1787853314.059954:0:23430:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787853314.059968:0:23430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787853314.059982:0:23430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8cfbe025cd70) 00000020:00000080:0.0:1787853314.059998:0:23430:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787853314.188092:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787853314.190808:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787853314.193501:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.194812:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.195098:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.195588:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.195986:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.196236:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.196927:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.197136:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.197623:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.197826:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.198356:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787853314.198777:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787853314.199600:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787853314.199864:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787853314.200592:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.202508:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.203638:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.204435:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.204973:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.205275:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.205666:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.205927:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.206182:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.206566:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.206800:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.207088:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.207455:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.207763:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.208497:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.209128:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.209624:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.209874:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.210111:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.210643:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.210899:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.211140:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.211496:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.211703:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.211928:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.212137:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.212415:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787853314.217809:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.218577:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787853314.218881:0:23430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00080000:01000000:1.0:1787853314.222411:0:23430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787853314.222666:0:23430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787853314.222681:0:23430:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787853314.222694:0:23430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2df0 00000020:01000004:1.0:1787853314.222702:0:23430:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787853314.222726:0:23430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787853314.222730:0:23430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787853314.222736:0:23430:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787853314.222765:0:23430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787853314.222769:0:23430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787853314.233602:0:23430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787853314.233643:0:23430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787853314.233648:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787853314.233655:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787853314.233657:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853314.233658:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853314.233659:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853314.233660:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853314.233661:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853314.233663:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853314.233664:0:23430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853314.233668:0:23430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787853314.233670:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853314.233671:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787853314.233672:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853314.233673:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853314.233674:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853314.233675:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853314.233676:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853314.233677:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853314.233678:0:23430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853314.233706:0:23430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787853314.233727:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491704832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853314.233804:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.234017:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb6763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.239060:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704832 00000100:00100000:3.0:1787853314.239076:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704832 00000100:00100000:3.0:1787853314.239149:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853314.239160:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:23430:x1874699491704832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787853314.239197:0:22693:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787853314.239216:0:22693:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787853314.239225:0:22693:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787853314.241101:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:23430:x1874699491704832:12345-0@lo:253:mount.lustre.0 Request processed in 1933us (7287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.241116:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853314.241252:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491704832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853314.241277:0:23430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787853314.241281:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853314.241283:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787853314.241284:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853314.241286:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853314.241287:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853314.241288:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853314.241289:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853314.241291:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853314.241293:0:23430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787853314.241317:0:23430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfac39d1000 from lustre-MDT0001 10000000:01000000:1.0:1787853314.241351:0:23430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787853314.241354:0:23430:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787853314.241361:0:23430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfbf7154d70 local copy 00010000:00010000:1.0:1787853314.241583:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853314.241702:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491704960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853314.241744:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.241796:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc7548840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.241922:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491704960 00000100:00100000:3.0:1787853314.241929:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491704960 00000100:00100000:3.0:1787853314.241967:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853314.241976:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:23430:x1874699491704960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853314.242115:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:23430:x1874699491704960:12345-0@lo:501:mount.lustre.0 Request processed in 140us (370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787853314.242122:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853314.243921:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491704960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787853314.243950:0:23430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787853314.243989:0:23430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787853314.243999:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.244957:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853314.245023:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfac39d1000 10000000:01000000:0.0:1787853314.245030:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787853314.245035:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cfbf7154d70 10000000:01000000:0.0:1787853314.245038:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787853314.245042:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cfbf7154d70 from 1 10000000:01000000:0.0:1787853314.245045:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787853314.245085:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.245094:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.245107:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853314.245130:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853314.245195:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.246565:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac44a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.249408:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705088 00000100:00100000:3.0:1787853314.249424:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705088 00000100:00100000:3.0:1787853314.249499:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853314.249510:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+12:23430:x1874699491705088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853314.249529:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853314.249549:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dfe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2df7 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.249579:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dfe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2df7 expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.249592:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfcccbe00/0xe2bf4b958af2dfe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2df7 expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.249600:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcccbe00, rc 0) 00000100:00100000:3.0:1787853314.249747:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+13:23430:x1874699491705088:12345-0@lo:101:mount.lustre.0 Request processed in 238us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.249771:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853314.252614:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853314.252647:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2dfe expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.252660:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2dfe expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853314.252683:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787853314.252702:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2dfe expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.252709:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3a00/0xe2bf4b958af2df7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2dfe expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853314.252721:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfac39d1000 10000000:01000000:1.0:1787853314.252730:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787853314.252736:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfac39d1000 from 1 10000000:01000000:1.0:1787853314.252739:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787853314.252774:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.252782:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.252809:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853314.252830:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853314.252911:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.252968:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc7548840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.253360:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705216 00000100:00100000:0.0:1787853314.253368:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705216 00000100:00100000:0.0:1787853314.253428:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853314.253438:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+13:23430:x1874699491705216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853314.253451:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853314.253475:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2600/0xe2bf4b958af2e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2e05 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.253497:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2600/0xe2bf4b958af2e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2e05 expref: 14 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.253519:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2600/0xe2bf4b958af2e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2e05 expref: 14 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.253528:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2600, rc 0) 00000100:00100000:0.0:1787853314.253570:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+14:23430:x1874699491705216:12345-0@lo:101:mount.lustre.0 Request processed in 133us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.253578:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853314.254711:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853314.254736:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e0c expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.254747:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2e0c expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853314.254763:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787853314.254779:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e0c expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.254787:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241a00/0xe2bf4b958af2e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e0c expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853314.254795:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787853314.254801:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853314.254807:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfac39d1000 10000000:01000000:1.0:1787853314.254810:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787853314.254814:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787853314.254817:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787853314.254859:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.254877:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.254885:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853314.254903:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853314.254949:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.254981:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc7548840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.255079:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705344 00000100:00100000:0.0:1787853314.255085:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705344 00000100:00100000:0.0:1787853314.255133:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787853314.255143:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+14:23430:x1874699491705344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853314.255154:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853314.255166:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2200/0xe2bf4b958af2e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2e13 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.255183:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2200/0xe2bf4b958af2e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2e13 expref: 15 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.255192:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2200/0xe2bf4b958af2e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2e13 expref: 15 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.255200:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2200, rc 0) 00000100:00100000:0.0:1787853314.255250:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705344:12345-0@lo:101:mount.lustre.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.255257:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853314.255414:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853314.255426:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e1a expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.255434:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2e1a expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853314.258030:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787853314.258808:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853314.270064:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787853314.270126:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787853314.270144:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787853314.270158:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787853314.270173:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787853314.270187:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787853314.270199:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787853314.270215:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787853314.270249:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787853314.271046:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787853314.271078:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787853314.271094:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787853314.271107:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787853314.271119:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787853314.271131:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787853314.271144:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787853314.271156:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787853314.271168:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787853314.271179:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787853314.271189:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787853314.271216:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787853314.271399:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787853314.271420:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787853314.271434:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787853314.271449:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787853314.271460:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787853314.271485:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787853314.271497:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787853314.271511:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787853314.271524:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787853314.271538:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787853314.271549:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787853314.271562:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787853314.271576:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787853314.271589:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787853314.271605:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787853314.271618:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787853314.271631:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787853314.271643:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787853314.271656:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787853314.271666:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787853314.271680:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787853314.271693:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787853314.271706:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787853314.271736:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787853314.271742:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787853314.272614:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853314.272693:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.272750:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.272818:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705472 00000100:00100000:1.0:1787853314.272825:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705472 00000100:00100000:1.0:1787853314.272915:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853314.272925:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853314.273108:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705472:12345-0@lo:501:mount.lustre.0 Request processed in 184us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.273117:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787853314.273227:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853314.273288:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853314.273347:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.273378:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.273628:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705600 00000100:00100000:1.0:1787853314.273634:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705600 00000100:00100000:1.0:1787853314.273673:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853314.273680:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853314.274755:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705600:12345-0@lo:503:mount.lustre.0 Request processed in 1072us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.274765:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853314.278976:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853314.279665:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853314.279755:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853314.279839:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.279913:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.279976:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705728 00000100:00100000:0.0:1787853314.279983:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705728 00000100:00100000:0.0:1787853314.280046:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853314.280055:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853314.280814:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705728:12345-0@lo:502:mount.lustre.0 Request processed in 758us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.280824:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853314.280956:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853314.281191:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787853314.281225:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787853314.281286:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787853314.281302:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787853314.281315:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787853314.281329:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787853314.281342:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787853314.281356:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787853314.281369:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787853314.281386:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787853314.281401:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787853314.281412:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787853314.281425:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787853314.281437:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787853314.281447:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787853314.281459:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787853314.281484:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787853314.281497:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787853314.281508:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787853314.281520:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787853314.281534:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787853314.281547:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787853314.281560:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787853314.281572:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787853314.281585:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787853314.281598:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787853314.281613:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787853314.281626:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787853314.281638:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787853314.281651:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787853314.281680:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787853314.281696:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787853314.281707:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787853314.281719:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787853314.281743:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787853314.281757:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787853314.281771:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787853314.281783:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787853314.281794:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787853314.281805:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787853314.281816:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787853314.281827:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787853314.281838:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787853314.281879:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787853314.281913:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853314.281964:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.282004:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705856 00000100:00100000:1.0:1787853314.282012:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705856 00000100:00100000:1.0:1787853314.282050:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853314.282058:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853314.282157:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491705856:12345-0@lo:502:mount.lustre.0 Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.282165:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853314.282218:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67be0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.282234:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491705856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853314.282272:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787853314.282279:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787853314.285207:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853314.285223:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.285226:0:23434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787853314.285349:0:23434:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787853314.285353:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853314.285458:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8cfbf71519d0) 00000020:00000080:1.0:1787853314.285503:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787853314.285511:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787853314.285598:0:23434:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787853314.285608:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2e28 00000020:00000080:1.0:1787853314.285826:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787853314.285831:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853314.285834:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.285836:0:23434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787853314.285839:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853314.285970:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.285972:0:23434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787853314.285976:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853314.285985:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8cfbe6084d70) 00000020:00000080:1.0:1787853314.285997:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787853314.286002:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787853314.286004:0:23434:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787853314.286006:0:23434:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787853314.286012:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787853314.286075:0:23434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac39d1000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787853314.286087:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8cfbe6080000) 00000020:00000080:1.0:1787853314.286096:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787853314.286155:0:23434:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787853314.286160:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2e3d 00000020:00000080:1.0:1787853314.286558:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787853314.286565:0:23434:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787853314.286572:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe2bf4b958af2e44 00080000:01000000:1.0:1787853314.286579:0:23434:0:(osd_handler.c:8928:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787853314.286583:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2e4b 00010000:00010000:2.0:1787853314.417763:0:23434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787853314.421735:0:23434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787853314.425157:0:23434:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787853314.426471:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787853314.426484:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853314.426490:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.426492:0:23434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787853314.426496:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853314.426501:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.426503:0:23434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787853314.426506:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787853314.426511:0:23434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:00000080:2.0:1787853314.426546:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853314.426560:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8cfbf1584d70) 00000020:00000080:2.0:1787853314.426583:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787853314.426588:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787853314.426667:0:23434:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787853314.426674:0:23434:0:(osd_handler.c:8928:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787853314.426681:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2e59 00010000:00080000:2.0:1787853314.426712:0:23434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbc525a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1787853314.431756:0:23434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787853314.435629:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787853314.435645:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787853314.435687:0:23434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787853314.435713:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2e60 00000100:00080000:2.0:1787853314.435725:0:23434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853314.435731:0:23434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfbc525a000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853314.435767:0:23434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbf60b0000 x1874699491705984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787853314.435861:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491705984:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853314.435997:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.436367:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491705984 00000100:00100000:0.0:1787853314.436375:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491705984 00000100:00100000:0.0:1787853314.436420:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853314.436428:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491705984:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787853314.436452:0:22704:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1787853314.436510:0:22704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2e67 00000004:00100000:0.0:1787853314.436746:0:22704:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787853314.436753:0:22704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1787853314.437102:0:23434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787853314.437180:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853314.437186:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437188:0:23434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787853314.437192:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787853314.437194:0:23434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787853314.437196:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853314.437198:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853314.437199:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787853314.437202:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437203:0:23434:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787853314.437205:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853314.437210:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437211:0:23434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787853314.437233:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787853314.437278:0:23434:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787853314.437293:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853314.437296:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437297:0:23434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787853314.437300:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787853314.437301:0:23434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787853314.437303:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853314.437304:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853314.437306:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787853314.437308:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437309:0:23434:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787853314.437312:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787853314.437315:0:23434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787853314.437318:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853314.437320:0:23434:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787853314.437323:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787853314.437327:0:23434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1787853314.437352:0:23434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787853314.437354:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853314.437368:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cfbf1580000) 00000020:00000080:2.0:1787853314.437382:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787853314.437387:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787853314.437441:0:23434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787853314.437447:0:23434:0:(osd_handler.c:8928:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787853314.437452:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2e75 00010000:00080000:2.0:1787853314.437529:0:23434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbfcd88800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.129@tcp at head 00000100:00080000:0.0:1787853314.437635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787853314.437641:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787853314.437644:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853314.437649:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1787853314.437654:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787853314.437659:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfbc8b82800 using connection 192.168.201.129@tcp/0@lo 00010000:00010000:2.0:1787853314.437742:0:23434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787853314.437809:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32c000 x1874699491706112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:2.0:1787853314.440082:0:23434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787853314.440585:0:23434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787853314.444065:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491706112:0@lo:38:kworker.0 00000100:00100000:2.0:1787853314.444284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.444344:0:22703:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787853314.444354:0:22703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:3.0:1787853314.447006:0:23434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1787853314.447291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853314.447297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853314.447300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853314.447303:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787853314.447386:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853314.447405:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491706240:0@lo:400:kworker.0 00000100:00100000:0.0:1787853314.447485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787853314.448264:0:23434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787853314.448425:0:23434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1787853314.448866:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491706240 00000100:00100000:3.0:1787853314.448874:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491706240 00000100:00100000:3.0:1787853314.448921:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853314.448941:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491706240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853314.449010:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491706240:12345-0@lo:400:kworker.0 Request processed in 81us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.449017:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787853314.449056:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfbfc32cb40 x1874699491706240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853314.449070:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491706240:0@lo:400:kworker.0 00000100:00080000:0.0:1787853314.450079:0:22704:0:(import.c:65:import_set_state_nolock()) ffff8cfac39d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853314.450362:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874699491705984:12345-0@lo:38:llog_process_th.0 Request processed in 13933us (14364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.450373:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853314.450394:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491706112 00000100:00100000:0.0:1787853314.450399:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491706112 00000100:00100000:0.0:1787853314.450417:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853314.450422:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491706112:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787853314.450478:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1874699491706112:12345-0@lo:38:kworker.0 Request processed in 55us (6195us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787853314.450486:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853314.450659:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853314.450667:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853314.450671:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787853314.450675:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491706112:0@lo:38:kworker.0 00000100:00100000:3.0:1787853314.450687:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853314.450709:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787853314.450717:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787853314.450723:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787853314.450726:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc525a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787853314.450742:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491705984:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853314.450854:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000040:00080000:2.0:1787853314.451481:0:23440:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787853314.451486:0:23440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787853314.452795:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787853314.452810:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787853314.452878:0:23434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787853314.452899:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2e7c 00000100:00080000:3.0:1787853314.452908:0:23434:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853314.452914:0:23434:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfbfcd88800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853314.452958:0:23434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4751e00 x1874699491706496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853314.452986:0:23434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787853314.453034:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853314.453038:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.453040:0:23434:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787853314.453043:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787853314.453046:0:23434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1787853314.453048:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853314.453049:0:23434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853314.453051:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787853314.453054:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.453055:0:23434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787853314.453058:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853314.453062:0:23434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787853314.453065:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.453067:0:23434:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787853314.453070:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787853314.453083:0:23434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:3.0:1787853314.453107:0:23434:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787853314.453110:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853314.453122:0:23434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cfbfce419d0) 00000020:00000080:3.0:1787853314.453432:0:23434:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787853314.453442:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787853314.453525:0:23434:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787853314.453531:0:23434:0:(osd_handler.c:8928:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787853314.453538:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe2bf4b958af2e8a 00010000:00080000:3.0:1787853314.453575:0:23434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbc3750800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.129@tcp at head 00000100:00100000:1.0:1787853314.453613:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491706496:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1787853314.453764:0:23434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787853314.453831:0:23434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787853314.453866:0:23434:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000400:00000100:1.0:1787853314.454358:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491706496 offset 0 length 520: 4 00000100:00080000:0.0:1787853314.454811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853314.454817:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853314.454820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853314.454823:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787853314.455829:0:23434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853314.456254:0:23434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787853314.456372:0:23434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:2.0:1787853314.456473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491706368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787853314.456553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.456685:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491706368 00000100:00100000:0.0:1787853314.456694:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491706368 00000100:00100000:0.0:1787853314.456752:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853314.456761:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874699491706368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787853314.456796:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787853314.456910:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874699491706368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.456924:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853314.456940:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491706368:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787853314.467415:0:23442:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787853314.467429:0:23442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787853314.468051:0:23434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787853314.468064:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787853314.468107:0:23434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787853314.468130:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2e91 00000100:00080000:1.0:1787853314.468142:0:23434:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853314.468148:0:23434:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853314.468184:0:23434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd93480 x1874699491706624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853314.468422:0:23434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787853314.468543:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491706624:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787853314.468603:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491706624 offset 0 length 520: 4 00000020:01000000:1.0:1787853314.470629:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853314.470637:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.470639:0:23434:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787853314.470643:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853314.470648:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.470649:0:23434:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853314.470652:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853314.470654:0:23434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853314.470656:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853314.470658:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.470660:0:23434:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787853314.470662:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853314.470664:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.470665:0:23434:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853314.470668:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787853314.470695:0:23434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853314.470697:0:23434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853314.470698:0:23434:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853314.470701:0:23434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1787853314.471077:0:23430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787853314.471108:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787853314.471144:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e1a expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.471156:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfc241800/0xe2bf4b958af2e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e1a expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853314.471165:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfac39d1000 from 1 10000000:01000000:3.0:1787853314.471168:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853314.471210:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.471246:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.471258:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853314.471437:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491706752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853314.471516:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.471566:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853314.471631:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491706752 00000100:00100000:2.0:1787853314.471640:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491706752 00000100:00100000:2.0:1787853314.471698:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853314.471707:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+15:23430:x1874699491706752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853314.471721:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853314.471734:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2e98 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.471757:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 16 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.471768:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 16 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.471777:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794c00, rc 0) 00000100:00100000:2.0:1787853314.471817:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:23430:x1874699491706752:12345-0@lo:101:mount.lustre.0 Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853314.471824:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853314.471957:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491706752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853314.471975:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.471984:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853314.472739:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491706880:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787853314.472786:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.472929:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19ca80 going to sleep for 11 seconds 00000100:00080000:1.0:1787853314.476130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853314.476144:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853314.476172:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853314.476176:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853314.478115:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491706880 00000100:00100000:2.0:1787853314.478210:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491706880 00000100:00100000:2.0:1787853314.478570:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787853314.478581:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:23430:x1874699491706880:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787853314.478608:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787853314.478637:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787853314.478640:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787853314.478783:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:23430:x1874699491706880:12345-0@lo:256:mount.lustre.0 Request processed in 203us (5995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853314.478792:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853314.478895:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491706880:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787853314.479549:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787853314.479585:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.479597:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853314.479619:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac39d1000 from 1 10000000:01000000:3.0:1787853314.479622:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853314.479659:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.479668:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.479677:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853314.479698:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853314.479741:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.484430:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707008 00000100:00100000:1.0:1787853314.484447:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707008 00000100:00100000:0.0:1787853314.486056:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853314.486079:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:23430:x1874699491707008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853314.486098:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853314.486118:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2ea6 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853314.486270:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1787853314.486301:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.486314:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.486323:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff3e00, rc 0) 00000100:00100000:0.0:1787853314.486394:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707008:12345-0@lo:101:mount.lustre.0 Request processed in 326us (6653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.486401:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853314.486436:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853314.486470:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.486482:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853314.487674:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787853314.488231:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853314.488476:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787853314.488502:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787853314.488517:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787853314.488532:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787853314.488545:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787853314.488559:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787853314.488574:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787853314.488588:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787853314.488795:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787853314.488815:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787853314.488827:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787853314.488996:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787853314.489004:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787853314.489148:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853314.489219:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.489370:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.489424:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707136 00000100:00100000:1.0:1787853314.489432:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707136 00000100:00100000:1.0:1787853314.489535:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787853314.489545:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853314.490035:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707136:12345-0@lo:501:mount.lustre.0 Request processed in 489us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.490045:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787853314.490159:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853314.490199:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853314.490253:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.490276:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.490389:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707264 00000100:00100000:0.0:1787853314.490394:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707264 00000100:00100000:0.0:1787853314.490429:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853314.490437:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853314.490536:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707264:12345-0@lo:503:mount.lustre.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.490543:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787853314.490718:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853314.491164:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853314.491257:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853314.491298:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.491333:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.491342:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707392 00000100:00100000:1.0:1787853314.491349:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707392 00000100:00100000:1.0:1787853314.491389:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853314.491397:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853314.491505:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707392:12345-0@lo:502:mount.lustre.0 Request processed in 109us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.491513:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787853314.491536:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853314.491704:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787853314.491728:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787853314.491754:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787853314.491765:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787853314.491778:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787853314.491790:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787853314.491800:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787853314.491811:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787853314.491822:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787853314.491834:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1787853314.493352:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1787853314.493416:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853314.493503:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.493594:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.497025:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707520 00000100:00100000:0.0:1787853314.497044:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707520 00000100:00100000:1.0:1787853314.497431:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787853314.497443:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853314.497640:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707520:12345-0@lo:502:mount.lustre.0 Request processed in 199us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.497648:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787853314.497743:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853314.497827:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787853314.497869:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787853314.503078:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853314.503092:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503095:0:23444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787853314.503102:0:23444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac39d1000 00000020:00000080:3.0:1787853314.503105:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853314.503116:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853314.503119:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503120:0:23444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787853314.503122:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853314.503124:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503126:0:23444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787853314.503141:0:23444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac39d1000 00000020:00000080:3.0:1787853314.503143:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853314.503194:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853314.503198:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503199:0:23444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787853314.503202:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853314.503204:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503205:0:23444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787853314.503209:0:23444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac39d1000 00000020:00000080:3.0:1787853314.503211:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853314.503262:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853314.503266:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503267:0:23444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787853314.503270:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853314.503272:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503273:0:23444:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787853314.503277:0:23444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac39d1000 00000020:00000080:3.0:1787853314.503279:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787853314.503302:0:23444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853314.503305:0:23444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853314.503306:0:23444:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787853314.503309:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787853314.506831:0:23430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787853314.506927:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853314.506957:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.506970:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853314.507034:0:23430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787853314.507037:0:23430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfac39d1000 10000000:01000000:2.0:1787853314.507040:0:23430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfac39d1000 10000000:01000000:2.0:1787853314.507044:0:23430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853314.507050:0:23430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfac39d1000 from 1 10000000:01000000:2.0:1787853314.507052:0:23430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787853314.507094:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507103:0:23430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507114:0:23430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853314.507150:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853314.507220:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.507283:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707648 00000100:00100000:2.0:1787853314.507290:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707648 00000100:00100000:2.0:1787853314.507333:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853314.507342:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:23430:x1874699491707648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853314.507355:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853314.507368:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4795a00/0xe2bf4b958af2ebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2eb4 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507391:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4795a00/0xe2bf4b958af2ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2eb4 expref: 18 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507402:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4795a00/0xe2bf4b958af2ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2eb4 expref: 18 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507411:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4795a00, rc 0) 00000100:00100000:2.0:1787853314.507444:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491707648:12345-0@lo:101:mount.lustre.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853314.507451:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853314.507515:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1787853314.507536:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853314.507550:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ebb expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853314.507559:0:23430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ebb expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853314.515708:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787853314.516063:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853314.522451:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787853314.522530:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787853314.522546:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787853314.522559:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787853314.522571:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787853314.522584:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787853314.522594:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787853314.522607:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787853314.522619:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787853314.522632:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787853314.522660:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787853314.522674:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787853314.522685:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787853314.522698:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787853314.522710:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787853314.522720:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787853314.522732:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787853314.522744:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787853314.522757:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787853314.522778:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787853314.522791:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787853314.522804:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787853314.522817:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787853314.522830:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787853314.522865:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787853314.522881:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787853314.522908:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787853314.522920:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787853314.522932:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787853314.522944:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787853314.522958:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787853314.522970:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787853314.522982:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787853314.522993:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787853314.523004:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787853314.523015:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787853314.523027:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787853314.523038:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787853314.523049:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787853314.523060:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787853314.523071:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787853314.523083:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787853314.523109:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787853314.523125:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787853314.523157:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787853314.523170:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787853314.523184:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787853314.523195:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787853314.523310:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787853314.523331:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787853314.523348:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787853314.523355:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787853314.523479:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853314.523549:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.523607:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853314.524887:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707776 00000100:00100000:2.0:1787853314.524901:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707776 00000100:00100000:2.0:1787853314.524960:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853314.524982:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491707776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853314.525780:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491707776:12345-0@lo:501:mount.lustre.0 Request processed in 795us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853314.525793:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853314.525892:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853314.525944:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853314.526004:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.526041:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.526340:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491707904 00000100:00100000:3.0:1787853314.526346:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491707904 00000100:00100000:3.0:1787853314.526387:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787853314.526395:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491707904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853314.527527:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491707904:12345-0@lo:503:mount.lustre.0 Request processed in 1128us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.527539:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787853314.527770:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491707904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853314.528752:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853314.531073:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853314.531553:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.538086:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.538162:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708032 00000100:00100000:1.0:1787853314.538170:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708032 00000100:00100000:1.0:1787853314.538276:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853314.538293:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853314.538545:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708032:12345-0@lo:502:mount.lustre.0 Request processed in 253us (6992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.538552:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787853314.541005:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853314.541244:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1787853314.541277:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1787853314.541309:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1787853314.541325:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1787853314.541339:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1787853314.541354:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1787853314.541367:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1787853314.541378:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1787853314.541389:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1787853314.541401:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1787853314.541413:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1787853314.541424:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1787853314.541447:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1787853314.541473:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1787853314.541490:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1787853314.541503:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1787853314.541515:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1787853314.541528:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1787853314.541556:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1787853314.541572:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1787853314.541585:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1787853314.541598:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1787853314.541611:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1787853314.541625:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1787853314.541638:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1787853314.541650:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1787853314.541660:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1787853314.541673:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1787853314.541685:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1787853314.541697:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1787853314.541708:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1787853314.541721:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1787853314.541734:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1787853314.541746:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1787853314.541771:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1787853314.541785:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1787853314.541798:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1787853314.541811:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1787853314.541823:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1787853314.541835:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1787853314.541896:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1787853314.541909:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1787853314.541921:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1787853314.541933:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1787853314.541946:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1787853314.541972:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1787853314.541986:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1787853314.542000:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1787853314.542055:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853314.542133:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853314.542183:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.542333:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708160 00000100:00100000:3.0:1787853314.542339:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708160 00000100:00100000:3.0:1787853314.542397:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787853314.542406:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853314.542540:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708160:12345-0@lo:502:mount.lustre.0 Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.542548:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787853314.542655:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853314.542818:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787853314.542866:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787853314.542889:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853314.542922:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.542946:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708288 00000100:00100000:0.0:1787853314.542950:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708288 00000100:00100000:0.0:1787853314.542975:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787853314.542982:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853314.543042:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708288:12345-0@lo:502:mount.lustre.0 Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.543048:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787853314.543081:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853314.543092:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853314.543123:0:23430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787853314.543130:0:23430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787853314.544039:0:23449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787853314.544056:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8cfbf15833a0) 00000020:00000080:2.0:1787853314.544078:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787853314.544167:0:23449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac39d1000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787853314.544172:0:23449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac39d1000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787853314.544175:0:23449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac39d1000 3 00010000:00080000:2.0:1787853314.544203:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfac4438000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1787853314.545894:0:23449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787853314.546105:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787853314.546149:0:23449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853314.546166:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe2bf4b958af2ec9 00000100:00080000:2.0:1787853314.546176:0:23449:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853314.546183:0:23449:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cfac4438000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853314.546223:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbf60b21c0 x1874699491708416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853314.546249:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787853314.546560:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874699491708416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853314.546644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.547022:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708416 00000100:00100000:0.0:1787853314.547029:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708416 00000100:00100000:0.0:1787853314.547060:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853314.547067:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491708416:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787853314.547090:0:22700:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1787853314.547120:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe2bf4b958af2ed0 00000004:00100000:0.0:1787853314.547133:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787853314.547159:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8cfac3f74000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853314.547205:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874699491708416:12345-0@lo:38:llog_process_th.0 Request processed in 137us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.547213:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787853314.547274:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfbf60b21c0 x1874699491708416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853314.547285:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853314.547292:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787853314.547298:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787853314.547303:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853314.547305:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac4438000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853314.547311:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874699491708416:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787853314.549015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853314.549024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853314.549027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853314.549030:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787853314.550810:0:23449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1787853314.554613:0:23430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787853314.554717:0:23430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853314.554750:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ebb expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853314.554763:0:23430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4795200/0xe2bf4b958af2eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ebb expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787853314.554873:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787853314.554875:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787853314.554877:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853314.554878:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853314.554880:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853314.554881:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853314.554882:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853314.554884:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853314.554886:0:23430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853314.554890:0:23430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787853314.554892:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853314.554894:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787853314.554895:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853314.554896:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853314.554897:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853314.554898:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853314.554899:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853314.554900:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853314.554901:0:23430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853314.554931:0:23430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787853314.554955:0:23430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853314.555034:0:23430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853314.555091:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708544 00000100:00100000:1.0:1787853314.555099:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708544 00000100:00100000:1.0:1787853314.555151:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787853314.555159:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787853314.555189:0:22692:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787853314.555205:0:22692:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787853314.570752:0:23430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf1576900 going to sleep for 11 seconds 00000001:00100000:3.0:1787853314.572830:0:22678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787853314.572984:0:22692:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787853314.573036:0:22692:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787853314.573965:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:23430:x1874699491708544:12345-0@lo:253:mount.lustre.0 Request processed in 18800us (18924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.573981:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787853314.574187:0:23430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:23430:1874699491708544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787853314.574202:0:23430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787853314.574205:0:23430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853314.574207:0:23430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787853314.574208:0:23430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853314.574210:0:23430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853314.574212:0:23430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853314.574213:0:23430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853314.574214:0:23430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787853314.574216:0:23430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853314.574218:0:23430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787853314.574254:0:23430:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787853314.577195:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 20000000:01000000:3.0:1787853314.577625:0:22714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853314.577641:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787853314.577672:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577691:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577698:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577706:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577752:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577767:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853314.577784:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491708672:0@lo:104: 00000100:00100000:3.0:1787853314.577866:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853314.577917:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.577926:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853314.577934:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491708800:0@lo:104: 00000100:00100000:3.0:1787853314.577956:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.577979:0:22714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc19c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.578026:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708672 00000100:00100000:3.0:1787853314.578038:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708672 00000100:00100000:3.0:1787853314.578072:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708800 00000100:00100000:3.0:1787853314.578074:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708800 00000100:00100000:3.0:1787853314.578102:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853314.578110:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491708672:12345-0@lo:104: 00010000:00010000:3.0:1787853314.578122:0:22682:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578183:0:22682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787853314.578188:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491708672:12345-0@lo:104: Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.578195:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853314.578211:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853314.578217:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491708800:12345-0@lo:104: 00010000:00010000:3.0:1787853314.578236:0:22682:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578268:0:22682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787853314.578273:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491708800:12345-0@lo:104: Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.578278:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853314.578309:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491708672:0@lo:104: 00000100:00100000:3.0:1787853314.578316:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491708800:0@lo:104: 00010000:00010000:3.0:1787853314.578341:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578357:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853314.578363:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578375:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfccca400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:3.0:1787853314.578379:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578386:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853314.578393:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853314.578399:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853314.578426:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578433:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853314.578454:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853314.578473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787853314.578475:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca400/0xe2bf4b958af2e98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2e9f expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853314.578484:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491708928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853314.578486:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853314.578488:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578494:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfccca200 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:3.0:1787853314.578497:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578513:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853314.578520:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853314.578525:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853314.578539:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578544:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853314.578560:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578567:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfccca200/0xe2bf4b958af2dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ddb expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853314.578582:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853314.578583:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853314.578585:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853314.578591:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853314.578612:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491709056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853314.578647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.578950:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491708928 00000100:00100000:0.0:1787853314.578955:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491708928 00010000:00010000:0.0:1787853314.578979:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 18 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853314.579004:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853314.579010:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491708928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853314.579021:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853314.579025:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 18 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.579042:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 18 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.579056:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af2e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2e98 expref: 18 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.579068:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853314.579101:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:3645:x1874699491708928:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.579107:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853314.579136:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491708928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853314.579373:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853314.580342:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709056 00000100:00100000:0.0:1787853314.580352:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709056 00010000:00010000:0.0:1787853314.580381:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853314.580409:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853314.580418:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:3643:x1874699491709056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853314.580428:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853314.580433:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580444:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580469:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2dd4 expref: 17 pid: 22691 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580497:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580505:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853314.580530:0:22685:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002890260s 00010000:00010000:0.0:1787853314.580535:0:22685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580542:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580549:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580555:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580560:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccae00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853314.580564:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580571:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580587:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580598:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853314.580647:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:3643:x1874699491709056:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.580654:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787853314.580676:0:22714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580684:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853314.580690:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af2ed7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853314.580724:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491709056:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787853314.584504:0:23430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787853314.585032:0:23456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787853314.585391:0:23430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787853314.586246:0:23456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853314.588601:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.588672:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.588710:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bef00 going to sleep for 11 seconds 00000040:01000000:2.0:1787853314.588948:0:23430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787853314.588986:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787853314.589578:0:23430:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787853314.589588:0:23430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787853314.589641:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853314.590791:0:23456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000020:00080000:0.0:1787853314.590958:0:23455:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787853314.590963:0:23455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787853314.590990:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709184 00000100:00100000:0.0:1787853314.590999:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709184 00000100:00100000:0.0:1787853314.591082:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853314.591092:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709184:12345-0@lo:1000:lod0001_rec0000.0 00000004:00080000:1.0:1787853314.591327:0:23456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787853314.591538:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709184:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 447us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853314.591546:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1787853314.592090:0:23430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787853314.592810:0:23430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787853314.592860:0:23430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787853314.592954:0:23430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787853314.593753:0:23430:0:(osd_handler.c:5584:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1787853314.594774:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709184:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787853314.594820:0:23457:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787853314.601004:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709312:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.601086:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.601134:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853314.601177:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709312 00000100:00100000:1.0:1787853314.601185:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709312 00000100:00100000:1.0:1787853314.601237:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853314.601247:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709312:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787853314.601394:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709312:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853314.601404:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853314.601615:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709312:0@lo:1000:lod0001_rec0000.0 00000001:00000004:2.0:1787853314.601744:0:23430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787853314.602015:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23457:1874699491709440:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.602057:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.602098:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709440 00000100:00100000:3.0:1787853314.602102:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709440 00000100:00100000:3.0:1787853314.602133:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853314.602138:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1874699491709440:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.602367:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1874699491709440:12345-0@lo:900:lod0001_rec0000.0 Request processed in 227us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.602375:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853314.602397:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67be480 going to sleep for 11 seconds 00010000:00080000:3.0:1787853314.602414:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfac4750b40 x1874699491709440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787853330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853314.602426:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23457:1874699491709440:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.602492:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.602599:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853314.602625:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709568 00000100:00100000:3.0:1787853314.602630:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709568 00000100:00100000:3.0:1787853314.602777:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853314.602786:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787853314.602879:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23457:x1874699491709568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853314.602898:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853314.603162:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853314.603257:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23457:1874699491709568:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787853314.603382:0:23457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853314.606743:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000001:00080000:2.0:1787853314.606772:0:23430:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787853314.606821:0:23430:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9b8f056af988 00000004:00080000:3.0:1787853314.606829:0:23457:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1787853314.606830:0:23430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:3.0:1787853314.606836:0:23457:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:2.0:1787853314.607961:0:23430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787853314.607996:0:23430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787853314.608012:0:23430:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787853314.608027:0:23430:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787853314.608973:0:23430:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787853314.612752:0:23430:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787853314.962820:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853315.603780:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00000040:00080000:1.0:1787853315.605141:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853315.985171:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787853316.113809:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787853316.113818:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfac39d1000 from 12 10000000:01000000:2.0:1787853316.113825:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787853316.113897:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.113910:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.113922:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853316.113958:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853316.114040:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853316.114095:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf870a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853316.115994:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709696 00000100:00100000:3.0:1787853316.116007:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709696 00000100:00100000:3.0:1787853316.116068:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853316.116077:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:22695:x1874699491709696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853316.116093:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853316.116109:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2ede expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853316.116134:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853316.116144:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 17 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853316.116153:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfccca400, rc 0) 00000100:00100000:3.0:1787853316.116242:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491709696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853316.116259:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787853316.116340:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853316.116375:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.116384:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853316.116451:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787853316.116489:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853316.116617:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf870a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853316.120818:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709824 00000100:00100000:1.0:1787853316.120832:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709824 00000100:00100000:1.0:1787853316.120922:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853316.120941:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491709824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787853316.120968:0:22692:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787853316.120985:0:22692:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787853316.120988:0:22692:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787853316.121112:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491709824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853316.121121:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853316.121389:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787853316.121448:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787853316.121458:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.121468:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853316.121477:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787853316.121480:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfbfbd61000 from 12 10000000:01000000:2.0:1787853316.121483:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787853316.121511:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.121520:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853316.121528:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853316.121558:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853316.121590:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853316.121630:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf870a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853316.121780:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491709952 00000100:00100000:1.0:1787853316.121784:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491709952 00000100:00100000:1.0:1787853316.121819:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787853316.121826:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491709952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853316.121834:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853316.121877:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2eec expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853316.121898:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 18 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853316.121908:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 18 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853316.121917:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241200, rc 0) 00000100:00100000:1.0:1787853316.121961:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491709952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853316.121968:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787853316.122515:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491709952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853316.122530:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853316.122539:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853316.122589:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491710080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787853316.122622:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853316.122658:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc8702a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853316.122873:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710080 00000100:00100000:1.0:1787853316.122878:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710080 00000100:00100000:1.0:1787853316.122905:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853316.122919:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491710080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787853316.124498:0:22691:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787853316.124526:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787853316.124530:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787853316.124656:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491710080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1735us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853316.124666:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787853316.124696:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491710080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787853316.124758:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787853316.124768:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853316.124778:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853316.629059:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787853316.636020:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:3.0:1787853317.008103:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853317.649362:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:1.0:1787853318.041940:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853318.675928:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00010000:00010000:0.0:1787853319.062525:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853319.398122:0:23700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787853319.700227:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 0 seconds 00000100:00100000:1.0:1787853319.826201:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491710208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853319.826274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853319.826653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787853319.826659:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787853319.826663:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787853319.826672:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfbc8b82800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853319.826706:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47521c0 x1874699491710464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853319.826725:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853319.826730:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853319.826734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853319.826737:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853319.826745:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491710336:0@lo:400:kworker.0 00000100:00080000:3.0:1787853319.826753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853319.826758:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853319.826761:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853319.826765:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853319.826783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853319.826808:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874699491710592:0@lo:400:kworker.0 00000100:00100000:3.0:1787853319.826881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853319.826916:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491710464:0@lo:38:kworker.0 00000100:00100000:3.0:1787853319.826942:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853319.827636:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491710720:0@lo:400:kworker.0 00000100:00100000:2.0:1787853319.827677:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853319.827764:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710592 00000100:00100000:1.0:1787853319.827772:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710592 00000100:00100000:1.0:1787853319.827830:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710720 00000100:00100000:1.0:1787853319.827834:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710720 00000100:00100000:1.0:1787853319.827868:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853319.827877:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874699491710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853319.827951:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874699491710592:12345-0@lo:400:kworker.0 Request processed in 75us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853319.827959:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853319.827976:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853319.827982:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853319.828011:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491710720:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853319.828017:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853319.828079:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710336 00000100:00100000:3.0:1787853319.828098:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710336 00000100:00100000:3.0:1787853319.828191:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787853319.828199:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491710336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853319.828238:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491710336:12345-0@lo:400:kworker.0 Request processed in 40us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853319.828244:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787853319.828301:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfac47503c0 x1874699491710592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853319.828326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874699491710592:0@lo:400:kworker.0 00000100:00100000:3.0:1787853319.828358:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491710336:0@lo:400:kworker.0 00010000:00080000:3.0:1787853319.833689:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbd558e940 x1874699491710720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853319.833709:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491710720:0@lo:400:kworker.0 00000100:00100000:0.0:1787853319.834625:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710208 00000100:00100000:0.0:1787853319.834635:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710208 00000100:00100000:0.0:1787853319.834742:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710464 00000100:00100000:0.0:1787853319.834746:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710464 00000100:00100000:3.0:1787853319.838361:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853319.838396:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491710208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787853319.838433:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787853319.838639:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853319.838646:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1874699491710464:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787853319.838672:0:22703:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1787853319.838711:0:22703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2efa 00000004:00100000:2.0:1787853319.838727:0:22703:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787853319.838733:0:22703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787853319.839607:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491710208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (12241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853319.839621:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853319.839682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491710208:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787853319.848224:0:22703:0:(import.c:65:import_set_state_nolock()) ffff8cfbc4b65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853319.848342:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874699491710464:12345-0@lo:38:kworker.0 Request processed in 9693us (21398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853319.848353:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787853319.850670:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787853319.850685:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787853319.850692:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787853319.850696:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc8b82800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787853319.850726:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003243925c): req@ffff8cfbf60b2940 x1874699491703424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853319.850756:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491710464:0@lo:38:kworker.0 00000100:00100000:1.0:1787853319.850940:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853319.850982:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb676e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853319.851145:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491710848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853319.851172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853319.851302:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491703424 00000100:00100000:0.0:1787853319.851322:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491703424 00000100:00100000:0.0:1787853319.851380:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710848 00000100:00100000:0.0:1787853319.851383:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710848 00000100:00100000:0.0:1787853319.851398:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853319.851406:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22740:x1874699491703424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787853319.851488:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22740:x1874699491703424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853319.851495:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853319.851511:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853319.851593:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491710848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787853319.851617:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787853319.851655:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491710848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853319.851662:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853319.851694:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b2940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22740:1874699491703424:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787853319.851727:0:22740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787853319.851762:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22740:1874699491710976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787853319.851793:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853319.851824:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853319.851835:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491710976 00000100:00100000:0.0:1787853319.851838:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491710976 00000100:00100000:0.0:1787853319.851889:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853319.851895:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22740:x1874699491710976:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787853319.851997:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22740:x1874699491710976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853319.852004:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853319.852040:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22740:1874699491710976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787853319.852117:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22740:1874699491711104:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787853319.852253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491710848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787853319.853621:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853319.853657:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853319.854252:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711104 00000100:00100000:2.0:1787853319.854261:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711104 00000100:00100000:2.0:1787853319.854317:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853319.854327:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22740:x1874699491711104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787853319.854437:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22740:x1874699491711104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853319.854444:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853319.855267:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22740:1874699491711104:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787853319.855337:0:22740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853319.858312:0:22740:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787853319.858424:0:22740:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1787853319.858429:0:22740:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787853320.080066:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787853320.479660:0:23752:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787853320.479884:0:23752:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787853321.110417:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787853321.504023:0:23802:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787853321.504603:0:23802:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787853322.134470:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787853322.653571:0:23850:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5b384d10 20000000:00000080:1.0:1787853322.653589:0:23850:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfbc42ac400 uarg=0000000000000000 20000000:01000000:1.0:1787853322.653626:0:23850:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787853322.653633:0:23850:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787853322.653638:0:23850:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787853322.661873:0:23851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787853322.662698:0:23850:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787853322.678946:0:23850:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787853322.678979:0:23850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679000:0:23850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679009:0:23850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679016:0:23850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679059:0:23850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679075:0:23850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853322.679268:0:23850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1874699491711232:0@lo:104: 00000100:00100000:3.0:1787853322.679490:0:23850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853322.679591:0:23850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853322.679601:0:23850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 17 pid: 22693 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853322.679609:0:23850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1874699491711360:0@lo:104: 00000100:00100000:3.0:1787853322.679631:0:23850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853322.682425:0:23850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc8aa6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853322.682819:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711232 00000100:00100000:0.0:1787853322.682828:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711232 00000100:00100000:0.0:1787853322.683008:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711360 00000100:00100000:0.0:1787853322.683012:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711360 00000100:00100000:0.0:1787853322.683031:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853322.683041:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:23850:x1874699491711232:12345-0@lo:104: 00010000:00010000:0.0:1787853322.683057:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683336:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853322.683343:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:23850:x1874699491711232:12345-0@lo:104: Request processed in 303us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853322.683351:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853322.683371:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853322.683377:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:23850:x1874699491711360:12345-0@lo:104: 00010000:00010000:0.0:1787853322.683400:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683438:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787853322.683444:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:23850:x1874699491711360:12345-0@lo:104: Request processed in 68us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853322.683450:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787853322.683467:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853322.683473:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683481:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccbc00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853322.683485:0:22687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683494:0:22687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853322.683502:0:22687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853322.683508:0:22687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853322.683548:0:22687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683554:0:22687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853322.683577:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683584:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af2ea6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ead expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683604:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853322.683607:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683613:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853322.683616:0:22687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683623:0:22687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853322.683629:0:22687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853322.683634:0:22687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853322.683648:0:22687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683654:0:22687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853322.683660:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683665:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af2da3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2daa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.683680:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853322.683682:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853322.683684:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853322.683706:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491711488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853322.683752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853322.683788:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853322.683795:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491711616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853322.683818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853322.685080:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711488 00000100:00100000:1.0:1787853322.685094:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711488 00010000:00010000:1.0:1787853322.685134:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 18 pid: 22692 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853322.685162:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711616 00000100:00100000:1.0:1787853322.685165:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711616 00010000:00010000:1.0:1787853322.685177:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 19 pid: 22693 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853322.685190:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853322.685198:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:3645:x1874699491711488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853322.685213:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853322.685218:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 19 pid: 22692 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853322.685228:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 19 pid: 22692 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853322.685253:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853322.685335:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:3645:x1874699491711488:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853322.685344:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853322.685362:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853322.685368:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491711616:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853322.685748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491711488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853322.685928:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853322.686329:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853322.686338:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 18 pid: 22693 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686350:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 18 pid: 22693 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686368:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686376:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686394:0:22685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686402:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686408:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686414:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686420:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfccca000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853322.686434:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686443:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686452:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686462:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853322.686518:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491711616:12345-0@lo:103:ldlm_bl.0 Request processed in 1150us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853322.686526:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853322.686569:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491711616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853322.686791:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2ea6 expref: 17 pid: 22692 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853322.686806:0:23850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1874699491711232:0@lo:104: 00010000:00010000:0.0:1787853322.686954:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af2daa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2da3 expref: 16 pid: 22693 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853322.686966:0:23850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23850:1874699491711360:0@lo:104: 00010000:00010000:0.0:1787853322.686984:0:23850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686992:0:23850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.686999:0:23850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853322.687005:0:23850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfccca000/0xe2bf4b958af2f01 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853322.705149:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853323.155465:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787853323.986118:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853323.986126:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac39d1000 from 13 10000000:01000000:2.0:1787853323.986133:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853323.986174:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986186:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986196:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853323.986222:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491711744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853323.986290:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853323.986345:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853323.986367:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711744 00000100:00100000:2.0:1787853323.986373:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711744 00000100:00100000:2.0:1787853323.986431:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787853323.986441:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+16:22695:x1874699491711744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853323.986454:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853323.986466:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2f08 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986487:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986497:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 17 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986506:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794600, rc 0) 00000100:00100000:2.0:1787853323.986553:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491711744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853323.986559:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787853323.986654:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491711744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853323.986668:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853323.986675:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853323.986758:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853323.986784:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853323.986806:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853323.991254:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491711872 00000100:00100000:1.0:1787853323.991267:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491711872 00000100:00100000:1.0:1787853323.991335:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853323.991345:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491711872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853323.991516:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491711872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853323.991525:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853323.992917:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853323.993029:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853323.993088:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853323.993129:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853323.993145:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712000 00000100:00100000:2.0:1787853323.993151:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712000 00000100:00100000:2.0:1787853323.993193:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853323.993201:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491712000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853323.993308:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491712000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853323.993315:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853323.996493:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787853324.001593:0:23911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787853324.001883:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787853324.001906:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853324.001918:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.001931:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853324.001942:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853324.001944:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfbfbd61000 from 13 10000000:01000000:2.0:1787853324.001947:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853324.001986:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.001994:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.002008:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853324.002037:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.003231:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.003286:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfce57c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853324.003323:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712128 00000100:00100000:2.0:1787853324.003331:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712128 00000100:00100000:2.0:1787853324.003378:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853324.003386:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+17:22695:x1874699491712128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853324.003401:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853324.003424:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2f16 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.003449:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 18 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.003460:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 18 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.003468:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794400, rc 0) 00000100:00100000:2.0:1787853324.003507:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491712128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.003514:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853324.004360:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853324.004379:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.004389:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853324.004463:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.004503:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.004534:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853324.004548:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712256 00000100:00100000:2.0:1787853324.004552:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712256 00000100:00100000:2.0:1787853324.004580:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787853324.004587:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491712256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.005033:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491712256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 445us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.005047:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787853324.005155:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.005186:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.005228:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.005251:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853324.005265:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712384 00000100:00100000:2.0:1787853324.005268:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712384 00000100:00100000:2.0:1787853324.005292:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853324.005310:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491712384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853324.005390:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:22695:x1874699491712384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.005398:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853324.005437:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491712384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853324.011888:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787853324.012535:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787853324.012562:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853324.012573:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853324.012584:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853324.178436:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853324.947632:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853314/real 1787853314] req@ffff8cfbfbd93480 x1874699491706624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853324.947663:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd93480 x1874699491706624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853324.947673:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853314/real 1787853314] req@ffff8cfac4751e00 x1874699491706496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853324.947685:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfac4751e00 x1874699491706496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853324.947705:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853324.947729:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853324.947732:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491706624:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787853324.947738:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfcd88800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853324.947751:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853324.947755:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491706496:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787853324.947827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853324.947832:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853324.947834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853324.947837:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853324.947886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853324.947888:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787853324.947892:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbfcd88800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853324.947897:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:0.0:1787853324.947901:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787853324.947907:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfbfcd88800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853324.947925:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32cf00 x1874699491713024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853324.947938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853324.947940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787853324.947942:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853324.947945:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:0.0:1787853324.947947:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787853324.947951:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853324.947960:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32e940 x1874699491713152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853324.947988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491712768:0@lo:400:kworker.0 00000100:00100000:0.0:1787853324.948056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853324.948088:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853324.948094:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491712896:0@lo:400:kworker.0 00000100:00100000:0.0:1787853324.948137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853324.948170:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712768 00000100:00100000:0.0:1787853324.948177:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712768 00000100:00100000:0.0:1787853324.948221:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853324.948230:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853324.948288:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491712768:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853324.948296:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853324.948441:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491712512:0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.948443:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491712640:0@lo:400:kworker.0 00000100:00100000:3.0:1787853324.948486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.948491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853324.948532:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.948545:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712896 00000100:00100000:2.0:1787853324.948551:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712896 00000100:00100000:3.0:1787853324.948562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.948595:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712640 00000100:00100000:2.0:1787853324.948599:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712640 00000100:00100000:3.0:1787853324.948612:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491713280 00000100:00100000:3.0:1787853324.948617:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491713280 00000100:00100000:2.0:1787853324.948619:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853324.948629:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491712896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853324.948667:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853324.948678:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491713280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.948681:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491712896:12345-0@lo:400:kworker.0 Request processed in 44us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.948690:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853324.948706:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853324.948714:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491712640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853324.948722:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491713280:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853324.948729:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853324.948758:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491712640:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.948765:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853324.948786:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491712512 00000100:00100000:2.0:1787853324.948791:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491712512 00000100:00100000:2.0:1787853324.948821:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853324.948828:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3643:x1874699491712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.948877:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3643:x1874699491712512:12345-0@lo:400:kworker.0 Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.948884:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853324.948946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491713408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787853324.948969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853324.948998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491712640:0@lo:400:kworker.0 00000100:00100000:3.0:1787853324.949023:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491712512:0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.949024:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491713408 00000100:00100000:2.0:1787853324.949029:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491713408 00010000:00080000:3.0:1787853324.949041:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbfc32f0c0 x1874699491713280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853324.949052:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491713280:0@lo:400:kworker.0 00000100:00100000:2.0:1787853324.949056:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853324.949065:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491713408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787853324.949101:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787853324.949137:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491713408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853324.949144:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853324.949171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491713408:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787853324.949425:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbfc32cb40 x1874699491712768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853324.949436:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491712768:0@lo:400:kworker.0 00000100:00100000:0.0:1787853324.949455:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491712896:0@lo:400:kworker.0 00000100:00100000:0.0:1787853324.949491:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853324.949499:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491713536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853324.949526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853324.949552:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491713536 00000100:00100000:0.0:1787853324.949555:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491713536 00000100:00100000:0.0:1787853324.949577:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787853324.949583:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491713536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787853324.949601:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787853324.949633:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491713536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853324.949639:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787853324.949664:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491713536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853324.950381:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491713024:0@lo:8:kworker.0 00000400:00000100:3.0:1787853324.950420:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491713024 offset 0 length 520: 4 00000100:00100000:3.0:1787853324.950452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491713152:0@lo:8:kworker.0 00000400:00000100:3.0:1787853324.950468:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491713152 offset 0 length 520: 4 00010000:00010000:0.0:1787853325.204999:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853325.970134:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853310/real 1787853310] req@ffff8cfbfbd92d00 x1874699491704576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853325.970162:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd92d00 x1874699491704576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853325.970171:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853310/real 1787853310] req@ffff8cfbfbd92940 x1874699491704704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853325.970183:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfbd92940 x1874699491704704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787853325.970200:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853325.975820:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787853325.975838:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704576:0@lo:8:kworker.0 00000100:00080000:1.0:1787853325.975867:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787853325.975874:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787853325.975878:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491704704:0@lo:8:kworker.0 00000100:00080000:0.0:1787853325.976300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853325.976304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787853325.976306:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853325.976311:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1787853325.976316:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853325.976323:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfbd2304800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853325.976344:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4c06d00 x1874699491713920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853325.976365:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853325.976368:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787853325.976370:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853325.976374:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1787853325.976376:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853325.976380:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfbfdcb2800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853325.976390:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac4c07c00 x1874699491714048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853325.976412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853325.976416:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853325.976418:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853325.976421:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787853325.976447:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491714304:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976514:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853325.976550:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853325.976555:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491713664:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853325.976621:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491714432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853325.976669:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491713792:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853325.976708:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853325.976714:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491714176:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853325.976762:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714304 00000100:00100000:0.0:1787853325.976769:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714304 00000100:00100000:0.0:1787853325.976806:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491713792 00000100:00100000:0.0:1787853325.976808:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491713792 00000100:00100000:0.0:1787853325.976824:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853325.976832:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491714304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976901:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491714304:12345-0@lo:400:kworker.0 Request processed in 69us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853325.976909:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853325.976925:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853325.976930:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874699491713792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.976961:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874699491713792:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853325.976967:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853325.976983:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491713664 00000100:00100000:0.0:1787853325.976986:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491713664 00000100:00100000:0.0:1787853325.977007:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853325.977012:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491713664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977063:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:3645:x1874699491713664:12345-0@lo:400:kworker.0 Request processed in 50us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853325.977069:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853325.977093:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714432 00000100:00100000:0.0:1787853325.977096:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714432 00000100:00100000:0.0:1787853325.977115:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714176 00000100:00100000:0.0:1787853325.977117:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714176 00000100:00100000:0.0:1787853325.977128:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853325.977134:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491714432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977161:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491714432:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853325.977166:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853325.977177:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853325.977183:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491714176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977206:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491714176:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853325.977211:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853325.977247:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491713664:0@lo:400:kworker.0 00010000:00080000:0.0:1787853325.977258:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfac4c070c0 x1874699491714432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853325.977280:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491714432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491714304:0@lo:400:kworker.0 00010000:00080000:0.0:1787853325.977315:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfac4c05680 x1874699491714176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853325.977335:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491714176:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977347:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491713792:0@lo:400:kworker.0 00000100:00100000:0.0:1787853325.977373:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491713920:0@lo:8:kworker.0 00000400:00000100:0.0:1787853325.977399:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491713920 offset 0 length 520: 4 00000100:00100000:0.0:1787853325.977420:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491714048:0@lo:8:kworker.0 00000400:00000100:0.0:1787853325.977451:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874699491714048 offset 0 length 520: 4 00000001:00100000:1.0:1787853325.978071:0:23431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787853326.225123:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853326.870220:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853327.257774:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853328.273895:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787853329.264691:0:24200:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787853329.264695:0:24200:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787853329.264696:0:24200:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787853329.264807:0:24200:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfac443e000 00000020:01000004:1.0:1787853329.264823:0:24200:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787853329.264836:0:24200:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787853329.267642:0:24200:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cfbe02599d0) 00000020:00000080:0.0:1787853329.267671:0:24200:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1787853329.302120:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787853329.415898:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787853329.430412:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787853329.430892:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787853329.431513:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787853329.431716:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787853329.431937:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787853329.432719:0:24200:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787853329.434521:0:24200:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787853329.434768:0:24200:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787853329.434783:0:24200:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787853329.434795:0:24200:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2bf4b958af2f2b 00000020:01000004:2.0:1787853329.434801:0:24200:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787853329.434823:0:24200:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787853329.434826:0:24200:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787853329.434832:0:24200:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787853329.434837:0:24200:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787853329.434888:0:24200:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cfbf6f699d0) 00000020:00000080:2.0:1787853329.434902:0:24200:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787853329.436005:0:24200:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853329.436147:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853329.436153:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787853329.440557:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787853329.440570:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787853329.445809:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787853329.445822:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787853329.450223:0:24200:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853329.450485:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787853329.450491:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787853329.458972:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787853329.458989:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787853329.488451:0:24200:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853329.488729:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853329.488736:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787853329.491073:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787853329.491097:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787853329.511933:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787853329.511948:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787853329.522161:0:24200:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853329.522382:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787853329.522389:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787853329.529642:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787853329.529657:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787853329.596028:0:24200:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853329.596263:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787853329.596270:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787853329.597736:0:24200:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787853329.597748:0:24200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787853329.599154:0:24200:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787853329.599185:0:24200:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787853329.599192:0:24200:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787853329.614779:0:24200:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787853329.614831:0:24200:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787853329.614835:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787853329.614837:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853329.614839:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853329.614892:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853329.614893:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853329.614895:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853329.614897:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853329.614899:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853329.614900:0:24200:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853329.614904:0:24200:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787853329.614906:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853329.614914:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853329.614915:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853329.614916:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853329.614917:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853329.614918:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853329.614919:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853329.614920:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853329.614921:0:24200:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853329.615195:0:24200:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787853329.615228:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853329.615305:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.615357:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.615421:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714560 00000100:00100000:2.0:1787853329.615428:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714560 00000100:00100000:2.0:1787853329.615484:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853329.615492:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:24200:x1874699491714560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853329.615530:0:22693:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787853329.615533:0:22693:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787853329.615537:0:22693:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787853329.615988:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:24200:x1874699491714560:12345-0@lo:253:mount.lustre.0 Request processed in 495us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.615997:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787853329.616248:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853329.616259:0:24200:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787853329.616261:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853329.616263:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853329.616264:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853329.616265:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853329.616266:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853329.616267:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853329.616268:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853329.616269:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853329.616270:0:24200:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787853329.616291:0:24200:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfac443e000 from lustre-OST0000 10000000:01000000:1.0:1787853329.616316:0:24200:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787853329.616319:0:24200:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787853329.616328:0:24200:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfbf7154d70 local copy 00010000:00010000:1.0:1787853329.616338:0:24200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853329.616429:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853329.616459:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.616496:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853329.616551:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714688 00000100:00100000:0.0:1787853329.616555:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714688 00000100:00100000:0.0:1787853329.616601:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853329.616609:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:24200:x1874699491714688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853329.616686:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:24200:x1874699491714688:12345-0@lo:501:mount.lustre.0 Request processed in 77us (225us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853329.616699:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787853329.616828:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787853329.616878:0:24200:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787853329.616895:0:24200:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787853329.616901:0:24200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.616911:0:24200:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853329.616947:0:24200:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfac443e000 10000000:01000000:1.0:1787853329.616952:0:24200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787853329.616957:0:24200:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787853329.616960:0:24200:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853329.616970:0:24200:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787853329.616973:0:24200:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787853329.616991:0:24200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.616999:0:24200:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.617008:0:24200:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853329.617021:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853329.617045:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.617075:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853329.617175:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714816 00000100:00100000:3.0:1787853329.617179:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714816 00000100:00100000:3.0:1787853329.617213:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853329.617220:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+18:24200:x1874699491714816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853329.617235:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853329.617246:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfccca200/0xe2bf4b958af2f40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2f39 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.617268:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfccca200/0xe2bf4b958af2f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2f39 expref: 19 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.617279:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfccca200/0xe2bf4b958af2f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f39 expref: 19 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.617288:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfccca200, rc 0) 00000100:00100000:3.0:1787853329.617325:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491714816:12345-0@lo:101:mount.lustre.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.617331:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787853329.617449:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853329.617460:0:24200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f40 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.617474:0:24200:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2f40 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853329.619835:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787853329.621166:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853329.624264:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787853329.624328:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787853329.624346:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787853329.624360:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787853329.624370:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787853329.624380:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787853329.624390:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787853329.624402:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787853329.624413:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787853329.624423:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787853329.624433:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787853329.624443:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787853329.624464:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787853329.624468:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787853329.624970:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853329.625040:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.625095:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67becc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853329.625325:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491714944 00000100:00100000:3.0:1787853329.625332:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491714944 00000100:00100000:3.0:1787853329.625388:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787853329.625399:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491714944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853329.625577:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491714944:12345-0@lo:501:mount.lustre.0 Request processed in 179us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.625585:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787853329.625783:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491714944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853329.625826:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853329.625898:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.625929:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67becc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853329.626074:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715072 00000100:00100000:0.0:1787853329.626079:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715072 00000100:00100000:0.0:1787853329.626116:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853329.626124:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853329.633930:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715072:12345-0@lo:503:mount.lustre.0 Request processed in 7797us (8021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.633945:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853329.636173:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787853329.636704:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787853329.636786:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853329.636885:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.636936:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.637260:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715200 00000100:00100000:2.0:1787853329.637267:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715200 00000100:00100000:2.0:1787853329.637313:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787853329.637322:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853329.637764:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715200:12345-0@lo:502:mount.lustre.0 Request processed in 441us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.637772:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853329.638421:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853329.638636:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787853329.638664:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787853329.638696:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787853329.638712:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787853329.638724:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787853329.638738:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787853329.638752:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787853329.638779:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787853329.638793:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787853329.638805:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787853329.638816:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787853329.638828:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787853329.638890:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853329.638948:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.639432:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715328 00000100:00100000:0.0:1787853329.639439:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715328 00000100:00100000:0.0:1787853329.639485:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787853329.639494:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853329.639663:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715328:12345-0@lo:502:mount.lustre.0 Request processed in 169us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.639670:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853329.639912:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.639933:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853329.640165:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787853329.640177:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787853329.644213:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853329.644226:0:24217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787853329.644233:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853329.644236:0:24217:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787853329.644243:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853329.644260:0:24217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cfbfce40000) 00000020:00000080:3.0:1787853329.644288:0:24217:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787853329.644295:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787853329.644386:0:24217:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac443e000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787853329.644398:0:24217:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853329.644407:0:24217:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2bf4b958af2f4e 00010000:00010000:3.0:1787853329.651479:0:24217:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787853329.652261:0:24217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787853329.654432:0:24217:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787853329.658731:0:24217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787853329.658748:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853329.658754:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658757:0:24217:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787853329.658760:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787853329.658763:0:24217:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787853329.658765:0:24217:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853329.658766:0:24217:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853329.658767:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787853329.658770:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658772:0:24217:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787853329.658782:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853329.658785:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658787:0:24217:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853329.658789:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853329.658791:0:24217:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853329.658794:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853329.658796:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658797:0:24217:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787853329.658799:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853329.658802:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658804:0:24217:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853329.658807:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787853329.658833:0:24217:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853329.658836:0:24217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853329.658838:0:24217:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853329.658897:0:24217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787853329.659303:0:24200:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787853329.659336:0:24200:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787853329.659362:0:24200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f40 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.659374:0:24200:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfc240c00/0xe2bf4b958af2f39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f40 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853329.659390:0:24200:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac443e000 from 1 10000000:01000000:2.0:1787853329.659393:0:24200:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853329.659428:0:24200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.659435:0:24200:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.659446:0:24200:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853329.659472:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853329.659542:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.659590:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853329.659987:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715456 00000100:00100000:1.0:1787853329.659995:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715456 00000100:00100000:1.0:1787853329.660044:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787853329.660053:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:24200:x1874699491715456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853329.660068:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853329.660082:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2f55 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.660105:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.660117:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853329.660125:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240600, rc 0) 00000100:00100000:1.0:1787853329.660176:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715456:12345-0@lo:101:mount.lustre.0 Request processed in 124us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853329.660190:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787853329.660278:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853329.660294:0:24200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.660303:0:24200:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853329.661435:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787853329.661718:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853329.661933:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787853329.661960:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787853329.661988:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787853329.662002:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787853329.662017:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787853329.662044:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787853329.662060:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787853329.662072:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787853329.662086:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787853329.662099:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787853329.662113:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787853329.662131:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787853329.662136:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787853329.662214:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853329.662268:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853329.662327:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.662465:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715584 00000100:00100000:2.0:1787853329.662471:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715584 00000100:00100000:2.0:1787853329.662519:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787853329.662528:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853329.662650:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715584:12345-0@lo:501:mount.lustre.0 Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.662658:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787853329.662742:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853329.662772:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853329.662810:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853329.662830:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.663308:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715712 00000100:00100000:2.0:1787853329.663314:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715712 00000100:00100000:2.0:1787853329.663358:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853329.663366:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853329.663463:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715712:12345-0@lo:503:mount.lustre.0 Request processed in 98us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.663480:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787853329.664554:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853329.665020:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853329.665100:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853329.665164:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853329.665217:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc2c51900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.665340:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715840 00000100:00100000:2.0:1787853329.665346:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715840 00000100:00100000:2.0:1787853329.665383:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787853329.665390:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853329.665484:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715840:12345-0@lo:502:mount.lustre.0 Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.665492:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787853329.665602:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853329.665746:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787853329.665770:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787853329.665782:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787853329.665795:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787853329.665807:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787853329.665818:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787853329.665830:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787853329.665890:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787853329.665905:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787853329.665917:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787853329.665928:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787853329.665949:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853329.666084:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853329.666119:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc2c51900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853329.666162:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491715968 00000100:00100000:1.0:1787853329.666167:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491715968 00000100:00100000:1.0:1787853329.666207:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787853329.666214:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853329.666291:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491715968:12345-0@lo:502:mount.lustre.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853329.666298:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787853329.670262:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491715968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853329.670368:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787853329.670391:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787853329.674255:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853329.674269:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674272:0:24221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853329.674281:0:24221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac443e000 00000020:00000080:0.0:1787853329.674284:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853329.674291:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853329.674294:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674295:0:24221:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787853329.674297:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853329.674299:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674300:0:24221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787853329.674303:0:24221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac443e000 00000020:00000080:0.0:1787853329.674305:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853329.674368:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853329.674371:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674373:0:24221:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787853329.674375:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853329.674377:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674379:0:24221:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853329.674381:0:24221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac443e000 00000020:00000080:0.0:1787853329.674384:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853329.674399:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853329.674401:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674402:0:24221:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853329.674404:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853329.674406:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674408:0:24221:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787853329.674411:0:24221:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac443e000 00000020:00000080:0.0:1787853329.674413:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853329.674442:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853329.674445:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853329.674446:0:24221:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787853329.674449:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787853329.674509:0:24200:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787853329.674539:0:24200:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853329.674553:0:24200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.674564:0:24200:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853329.674609:0:24200:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787853329.674612:0:24200:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfac443e000 10000000:01000000:0.0:1787853329.674615:0:24200:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfac443e000 10000000:01000000:0.0:1787853329.674618:0:24200:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853329.674623:0:24200:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfac443e000 from 1 10000000:01000000:0.0:1787853329.674630:0:24200:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853329.674661:0:24200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.674669:0:24200:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.674679:0:24200:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853329.674702:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853329.674770:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.674812:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb69e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853329.677212:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716096 00000100:00100000:0.0:1787853329.677229:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716096 00000100:00100000:0.0:1787853329.677289:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787853329.677299:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:24200:x1874699491716096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853329.677318:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853329.677336:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2f63 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.677374:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2f63 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.677387:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff3e00/0xe2bf4b958af2f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f63 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.677397:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff3e00, rc 0) 00000100:00100000:0.0:1787853329.677471:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716096:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.677490:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787853329.677550:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853329.677573:0:24200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f6a expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.677583:0:24200:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2f6a expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853329.693061:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787853329.693405:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853329.693613:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787853329.693640:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787853329.693653:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787853329.693666:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787853329.693680:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787853329.693693:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787853329.693708:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787853329.693723:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787853329.693743:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787853329.693760:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787853329.693775:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787853329.693789:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787853329.693803:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787853329.693817:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787853329.693830:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787853329.697121:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787853329.697177:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787853329.697190:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787853329.697214:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787853329.697226:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787853329.697250:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787853329.697263:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787853329.697276:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787853329.697291:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787853329.697322:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787853329.697338:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787853329.697351:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787853329.697365:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787853329.697378:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787853329.697392:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787853329.697404:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787853329.697417:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787853329.697427:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787853329.697437:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787853329.697446:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787853329.697456:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787853329.697466:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787853329.697476:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787853329.697486:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787853329.697496:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787853329.697518:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787853329.697528:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787853329.697539:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787853329.697549:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787853329.697558:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787853329.697568:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787853329.697580:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787853329.697592:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787853329.697746:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787853329.697765:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787853329.697780:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787853329.697785:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787853329.697940:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853329.701071:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.704311:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67bef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853329.707809:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716224 00000100:00100000:3.0:1787853329.707827:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716224 00000100:00100000:3.0:1787853329.708043:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853329.708054:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853329.708235:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716224:12345-0@lo:501:mount.lustre.0 Request processed in 184us (7171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.708243:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853329.711101:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853329.711161:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853329.711240:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.711280:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.711301:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716352 00000100:00100000:2.0:1787853329.711307:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716352 00000100:00100000:2.0:1787853329.711359:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853329.711369:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853329.711481:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716352:12345-0@lo:503:mount.lustre.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.711489:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853329.711536:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853329.713332:0:24200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853329.713432:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853329.713504:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.713598:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254780 going to sleep for 11 seconds 00000100:00100000:3.0:1787853329.716281:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716480 00000100:00100000:3.0:1787853329.716296:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716480 00000100:00100000:3.0:1787853329.716439:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787853329.716449:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853329.716622:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716480:12345-0@lo:502:mount.lustre.0 Request processed in 174us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.716630:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787853329.716714:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853329.717008:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787853329.717040:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787853329.717058:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787853329.717072:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787853329.717085:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787853329.717097:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787853329.717110:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787853329.717136:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787853329.717166:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787853329.717182:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787853329.717207:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787853329.717223:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787853329.717236:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787853329.717248:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787853329.717261:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787853329.717275:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787853329.717288:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787853329.717302:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787853329.717316:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787853329.717329:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787853329.717341:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787853329.717354:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787853329.717366:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787853329.717379:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787853329.717406:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787853329.717422:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787853329.717440:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787853329.717452:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787853329.717472:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787853329.717486:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787853329.717498:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787853329.717510:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787853329.717523:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787853329.717535:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787853329.717546:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787853329.717557:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787853329.717567:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787853329.717579:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787853329.717591:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787853329.717602:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787853329.717624:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787853329.717637:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787853329.717647:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787853329.717658:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787853329.717671:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787853329.717681:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787853329.717692:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787853329.717704:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787853329.717749:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853329.717802:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.723115:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853329.723297:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716608 00000100:00100000:0.0:1787853329.723308:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716608 00000100:00100000:0.0:1787853329.723357:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787853329.723368:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853329.723559:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716608:12345-0@lo:502:mount.lustre.0 Request processed in 193us (5756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.723568:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787853329.723670:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853329.723921:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787853329.723950:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787853329.726099:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853329.726185:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853329.726247:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853329.726346:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716736 00000100:00100000:0.0:1787853329.726353:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716736 00000100:00100000:0.0:1787853329.726391:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787853329.726400:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853329.726524:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491716736:12345-0@lo:502:mount.lustre.0 Request processed in 124us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.726532:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853329.726731:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491716736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853329.726804:0:24200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787853329.726816:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787853329.730135:0:24227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787853329.730152:0:24227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cfbf6f6cd70) 00000020:00000080:2.0:1787853329.730177:0:24227:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787853329.730264:0:24227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac443e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853329.730268:0:24227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac443e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853329.730271:0:24227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac443e000 3 00010000:00080000:2.0:1787853329.730303:0:24227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfac447c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1787853329.733112:0:24227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787853329.733377:0:24227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787853329.733430:0:24227:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853329.733443:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe2bf4b958af2f78 00000100:00080000:2.0:1787853329.733453:0:24227:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853329.733459:0:24227:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfac447c800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853329.733495:0:24227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbf60b0b40 x1874699491716864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853329.733524:0:24227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787853329.733706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.733711:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.733714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.733717:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.733742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.733745:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.733748:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.733751:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787853329.733816:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491717120:0@lo:400:kworker.0 00000100:00100000:0.0:1787853329.733913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.733951:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853329.733957:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491716992:0@lo:400:kworker.0 00000100:00100000:3.0:1787853329.734059:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717120 00000100:00100000:3.0:1787853329.734073:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717120 00000100:00100000:3.0:1787853329.734116:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853329.734124:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491717120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853329.734174:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491717120:12345-0@lo:400:kworker.0 Request processed in 50us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.734181:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853329.734258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787853329.734289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbd558c3c0 x1874699491717120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853329.734304:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491717120:0@lo:400:kworker.0 00000100:00100000:0.0:1787853329.734333:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491717248:0@lo:400:kworker.0 00000100:00100000:0.0:1787853329.734357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.734377:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853329.734382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491717376:0@lo:400:kworker.0 00000100:00100000:0.0:1787853329.734403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.734489:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491716864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787853329.734518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.735073:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716992 00000100:00100000:2.0:1787853329.735079:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716992 00000100:00100000:2.0:1787853329.735111:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717248 00000100:00100000:2.0:1787853329.735114:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717248 00000100:00100000:2.0:1787853329.735142:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853329.735150:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491716992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853329.735213:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491716992:12345-0@lo:400:kworker.0 Request processed in 64us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.735219:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853329.735234:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853329.735241:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491717248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853329.735274:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491717248:12345-0@lo:400:kworker.0 Request processed in 34us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.735287:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787853329.737018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491717248:0@lo:400:kworker.0 00000100:00100000:0.0:1787853329.737054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491716992:0@lo:400:kworker.0 00000100:00100000:3.0:1787853329.739551:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717376 00000100:00100000:3.0:1787853329.739564:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717376 00000100:00100000:3.0:1787853329.739604:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491716864 00000100:00100000:3.0:1787853329.739607:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491716864 00000100:00100000:3.0:1787853329.739623:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853329.739631:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491717376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853329.739728:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491717376:12345-0@lo:400:kworker.0 Request processed in 97us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.739735:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853329.739752:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853329.739757:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491716864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787853329.739779:0:22700:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1787853329.739810:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe2bf4b958af2f7f 00000004:00100000:3.0:1787853329.739825:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787853329.739875:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8cfac4d7c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853329.739913:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874699491716864:12345-0@lo:38:llog_process_th.0 Request processed in 154us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.739919:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1787853329.740187:0:24227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787853329.740213:0:24227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cfbfce44d70) 00000020:00000080:3.0:1787853329.740231:0:24227:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787853329.740335:0:24227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac443e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787853329.740340:0:24227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac443e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787853329.740343:0:24227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac443e000 3 00010000:00080000:3.0:1787853329.740369:0:24227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfac4d7b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00080000:0.0:1787853329.741088:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbd558da40 x1874699491717376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853329.741104:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491717376:0@lo:400:kworker.0 00010000:00080000:0.0:1787853329.741140:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbf60b0b40 x1874699491716864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853329.741149:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853329.741156:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787853329.741162:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787853329.741167:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853329.741170:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac447c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853329.741182:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1874699491716864:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1787853329.742529:0:24227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787853329.742710:0:24227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787853329.742754:0:24227:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787853329.742765:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe2bf4b958af2f8d 00000100:00080000:3.0:1787853329.742773:0:24227:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853329.742778:0:24227:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cfac4d7b800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1787853329.742808:0:24227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbd558ed00 x1874699491717504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853329.742838:0:24227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787853329.742886:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.742891:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.742893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.742896:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.742900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.742903:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853329.742905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853329.742909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853329.744156:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1874699491717504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853329.744246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787853329.744495:0:24227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787853329.744552:0:24200:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787853329.744577:0:24200:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787853329.744601:0:24200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f6a expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.744612:0:24200:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3000/0xe2bf4b958af2f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2f6a expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787853329.744665:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787853329.744667:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787853329.744669:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853329.744670:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853329.744671:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853329.744673:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853329.744674:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853329.744676:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853329.744677:0:24200:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853329.744680:0:24200:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787853329.744683:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853329.744684:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787853329.744686:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853329.744687:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853329.744687:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853329.744689:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853329.744690:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853329.744691:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853329.744692:0:24200:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853329.744712:0:24200:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787853329.744726:0:24200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491717632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787853329.744770:0:24200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.744801:0:24200:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfc254540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853329.745063:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717504 00000100:00100000:3.0:1787853329.745070:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717504 00000100:00100000:3.0:1787853329.745111:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853329.745119:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491717504:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787853329.745153:0:22700:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1787853329.745188:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe2bf4b958af2f94 00000004:00100000:3.0:1787853329.745212:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787853329.745246:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8cfac4d7d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853329.745299:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874699491717504:12345-0@lo:38:llog_process_th.0 Request processed in 179us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853329.745307:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787853329.745460:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfbd558ed00 x1874699491717504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853329.745470:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853329.745477:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787853329.745484:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787853329.745487:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787853329.745489:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac4d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787853329.745494:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1874699491717504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853329.746100:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717632 00000100:00100000:2.0:1787853329.746106:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717632 00000100:00100000:2.0:1787853329.746141:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787853329.746149:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491717632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853329.746168:0:22691:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787853329.746180:0:22691:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787853329.753881:0:22691:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787853329.753900:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787853329.754245:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:24200:x1874699491717632:12345-0@lo:253:mount.lustre.0 Request processed in 8091us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.754257:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787853329.754327:0:24200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:24200:1874699491717632:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787853329.754341:0:24200:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787853329.754344:0:24200:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787853329.754346:0:24200:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787853329.754348:0:24200:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853329.754349:0:24200:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853329.754360:0:24200:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853329.754361:0:24200:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853329.754363:0:24200:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853329.754365:0:24200:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853329.754366:0:24200:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787853329.754380:0:24200:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787853329.756040:0:22714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853329.756047:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787853329.756071:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756089:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756097:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756105:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756145:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756159:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 20 pid: 22693 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853329.756175:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491717760:0@lo:104: 00000100:00100000:3.0:1787853329.756248:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853329.756330:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853329.756339:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853329.756348:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491717888:0@lo:104: 00000100:00100000:3.0:1787853329.756388:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853329.756414:0:22714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc351ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853329.759136:0:22681:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787853329.759170:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717760 00000100:00100000:2.0:1787853329.759179:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717760 00000100:00100000:2.0:1787853329.759230:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491717888 00000100:00100000:2.0:1787853329.759234:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491717888 00000100:00100000:2.0:1787853329.759251:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853329.759261:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491717760:12345-0@lo:104: 00010000:00010000:2.0:1787853329.759279:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.759394:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853329.759401:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491717760:12345-0@lo:104: Request processed in 142us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.759408:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853329.759426:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853329.759432:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdbf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491717888:12345-0@lo:104: 00010000:00010000:2.0:1787853329.759439:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.759470:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853329.759474:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdbf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491717888:12345-0@lo:104: Request processed in 44us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853329.759480:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787853329.759516:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853329.759522:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.759541:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794000 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853329.759545:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.759554:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853329.759561:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853329.759566:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787853329.759702:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491717760:0@lo:104: 00000100:00100000:3.0:1787853329.759712:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491717888:0@lo:104: 00010000:00010000:3.0:1787853329.759734:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760033:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760041:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853329.760068:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760075:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4794000/0xe2bf4b958af2eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ef3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760090:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853329.760093:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760099:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4795600 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853329.760102:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760118:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853329.760124:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853329.760128:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853329.760141:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760146:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853329.760152:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760157:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4795600/0xe2bf4b958af2ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2ee5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853329.760171:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853329.760173:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853329.760174:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853329.760181:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853329.760213:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491718016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853329.760253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853329.760292:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853329.760298:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491718144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853329.760320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853329.760484:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718016 00000100:00100000:0.0:1787853329.760490:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718016 00010000:00010000:0.0:1787853329.760512:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 21 pid: 22693 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853329.760538:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718144 00000100:00100000:0.0:1787853329.760541:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718144 00010000:00010000:0.0:1787853329.760551:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 22 pid: 22691 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853329.760563:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853329.760569:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:3643:x1874699491718016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853329.760581:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853329.760597:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 22 pid: 22693 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760615:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 22 pid: 22693 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760628:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc241200/0xe2bf4b958af2ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2eec expref: 22 pid: 22693 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760640:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853329.760674:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3643:x1874699491718016:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.760681:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853329.760694:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853329.760700:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac27d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:3643:x1874699491718144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853329.760715:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853329.760720:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760727:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760735:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af2ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2ede expref: 20 pid: 22691 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760745:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760753:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853329.760766:0:22684:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004719052s 00010000:00010000:0.0:1787853329.760770:0:22684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760777:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760784:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760789:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760794:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853329.760797:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760809:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760824:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.760838:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853329.760954:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac27d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:3643:x1874699491718144:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853329.761143:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787853329.761203:0:22714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.761212:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853329.761218:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcccb200/0xe2bf4b958af2f9b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853329.761539:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491718144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853329.761547:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491718016:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787853329.762731:0:24200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787853329.765517:0:24200:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787853329.765526:0:24200:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787853329.765557:0:24200:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787853329.765660:0:24200:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787853329.765679:0:24200:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787853329.765698:0:24200:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787853329.766695:0:24200:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787853329.766938:0:24200:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787853330.069078:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491718272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853330.069155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853330.069229:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718272 00000100:00100000:1.0:1787853330.069236:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718272 00000100:00100000:1.0:1787853330.069347:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787853330.069358:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491718272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853330.069392:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853330.069440:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491718272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853330.069448:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787853330.069494:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491718272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853330.070506:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853330.070520:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491718400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853330.070563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853330.070674:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718400 00000100:00100000:3.0:1787853330.070681:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718400 00000100:00100000:3.0:1787853330.070720:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853330.070728:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491718400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787853330.070756:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853330.070806:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491718400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853330.070813:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853330.070892:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491718400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787853330.325139:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787853330.777093:0:24280:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787853330.777784:0:24280:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787853331.344152:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853331.665044:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787853331.665062:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfac39d1000 from 13 10000000:01000000:3.0:1787853331.665068:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853331.665423:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853331.665436:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853331.665456:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853331.665486:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853331.665556:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853331.665819:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf866ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853331.668129:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718528 00000100:00100000:0.0:1787853331.668143:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718528 00000100:00100000:0.0:1787853331.668210:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787853331.668229:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+19:22695:x1874699491718528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853331.668245:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853331.668265:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2fa2 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668305:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 20 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668316:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 20 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668324:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2a00, rc 0) 00000100:00100000:0.0:1787853331.668395:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:22695:x1874699491718528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853331.668401:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787853331.668452:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853331.668471:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668479:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853331.668540:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853331.668578:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853331.668614:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb69ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853331.668628:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718656 00000100:00100000:0.0:1787853331.668631:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718656 00000100:00100000:0.0:1787853331.668654:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787853331.668661:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:22695:x1874699491718656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787853331.668675:0:22691:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787853331.668690:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787853331.668697:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787853331.668772:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:22695:x1874699491718656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853331.668779:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787853331.668809:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853331.668883:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853331.668891:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668898:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853331.668907:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853331.668909:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfbfbd61000 from 13 10000000:01000000:0.0:1787853331.668912:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853331.668944:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668952:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.668960:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853331.668973:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853331.668999:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853331.669014:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb69ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853331.669026:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718784 00000100:00100000:0.0:1787853331.669029:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718784 00000100:00100000:0.0:1787853331.669057:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787853331.669063:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:22695:x1874699491718784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853331.669070:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853331.669079:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af2fb0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.669093:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.669102:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 21 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.669108:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2800, rc 0) 00000100:00100000:0.0:1787853331.669135:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491718784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853331.669140:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787853331.669180:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853331.669190:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.669197:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853331.669231:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853331.669256:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853331.669266:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb69ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853331.669276:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491718912 00000100:00100000:0.0:1787853331.669279:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491718912 00000100:00100000:0.0:1787853331.669310:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853331.669316:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491718912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787853331.669324:0:22691:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787853331.669333:0:22691:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787853331.669336:0:22691:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787853331.669396:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491718912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853331.669403:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787853331.669430:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491718912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853331.669464:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853331.669470:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853331.669477:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853332.376066:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853332.945192:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853333.392176:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853334.416146:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853335.184182:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853335.184205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491719040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853335.184278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853335.184333:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719040 00000100:00100000:1.0:1787853335.184341:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719040 00000100:00100000:1.0:1787853335.184386:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853335.184395:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491719040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853335.184427:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853335.184473:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491719040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853335.184498:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853335.184549:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491719040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853335.186820:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853335.186855:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491719168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787853335.187036:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.187157:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719168 00000100:00100000:2.0:1787853335.187165:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719168 00000100:00100000:2.0:1787853335.187221:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853335.187230:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491719168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787853335.187263:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787853335.187309:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491719168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853335.187316:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787853335.188037:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853335.188042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853335.188045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853335.188048:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853335.188059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853335.188062:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853335.188071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853335.188073:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853335.188129:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491719296:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.188208:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491719808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.188254:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853335.188259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491719424:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.188317:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719808 00000100:00100000:2.0:1787853335.188322:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719808 00000100:00100000:2.0:1787853335.188363:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719424 00000100:00100000:2.0:1787853335.188366:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719424 00000100:00100000:2.0:1787853335.188381:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853335.188387:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491719808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188427:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491719808:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853335.188434:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853335.188448:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853335.188454:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491719424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188481:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491719424:12345-0@lo:400:kworker.0 Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853335.188487:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787853335.188541:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b3840 x1874699491719424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853335.188566:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491719424:0@lo:400:kworker.0 00010000:00080000:2.0:1787853335.188579:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b1a40 x1874699491719808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853335.188588:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491719808:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188685:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874699491719680:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.188731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853335.188737:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491719552:0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853335.188779:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719680 00000100:00100000:2.0:1787853335.188782:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719680 00000100:00100000:2.0:1787853335.188802:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719552 00000100:00100000:2.0:1787853335.188804:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719552 00000100:00100000:2.0:1787853335.188817:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853335.188823:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874699491719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853335.188886:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874699491719680:12345-0@lo:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853335.188892:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853335.189566:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719296 00000100:00100000:0.0:1787853335.189572:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719296 00000100:00100000:0.0:1787853335.189606:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787853335.189613:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3645:x1874699491719296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853335.189667:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3645:x1874699491719296:12345-0@lo:400:kworker.0 Request processed in 54us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853335.189681:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787853335.189724:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787853335.189728:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787853335.189763:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491719168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787853335.189795:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491719296:0@lo:400:kworker.0 00000100:00100000:0.0:1787853335.189832:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853335.189839:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491719552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853335.189893:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491719552:12345-0@lo:400:kworker.0 Request processed in 55us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853335.189899:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787853335.190224:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b0000 x1874699491719552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853335.190236:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491719552:0@lo:400:kworker.0 00010000:00080000:2.0:1787853335.190249:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b30c0 x1874699491719680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853335.190257:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1874699491719680:0@lo:400:kworker.0 00010000:00010000:0.0:1787853335.441048:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853336.081596:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853336.471257:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853336.736614:0:24571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787853337.488231:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787853337.668805:0:24624:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787853337.669398:0:24624:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1787853338.493948:0:24674:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787853338.494168:0:24674:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787853338.514409:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853339.028636:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853324/real 1787853324] req@ffff8cfbfc32cf00 x1874699491713024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853339.028667:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfc32cf00 x1874699491713024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853339.028677:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853324/real 1787853324] req@ffff8cfbfc32e940 x1874699491713152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853339.028688:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfbfc32e940 x1874699491713152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853339.028708:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfcd88800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853339.028731:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853339.028735:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491713024:0@lo:8:kworker.0 00000100:00080000:3.0:1787853339.028740:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853339.028745:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853339.028748:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491713152:0@lo:8:kworker.0 00000100:00080000:0.0:1787853339.029640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853339.029645:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853339.029648:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853339.029650:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787853339.029665:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853339.029668:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787853339.029671:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbfcd88800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853339.029677:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 663 00000100:00080000:0.0:1787853339.029682:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853339.029689:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfbfcd88800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853339.029717:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47f4f00 x1874699491720448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853339.029731:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853339.029733:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787853339.029735:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853339.029738:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 663 00000100:00080000:0.0:1787853339.029741:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853339.029744:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853339.029756:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47f70c0 x1874699491720576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853339.029809:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491719936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.029940:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491720064:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030005:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.030060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491720832:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.030113:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787853339.030119:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491720192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.030159:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491720960:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.030205:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491720320:0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.030253:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720064 00000100:00100000:1.0:1787853339.030259:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720064 00000100:00100000:1.0:1787853339.030293:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720320 00000100:00100000:1.0:1787853339.030295:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720320 00000100:00100000:1.0:1787853339.030308:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853339.030315:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491720064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030377:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491720064:12345-0@lo:400:kworker.0 Request processed in 63us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.030384:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853339.030399:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787853339.030405:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491720320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.030448:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491720320:12345-0@lo:400:kworker.0 Request processed in 44us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.030454:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853339.030586:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491720448:0@lo:8:kworker.0 00000100:00100000:3.0:1787853339.030616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853339.030644:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491720576:0@lo:8:kworker.0 00000100:00100000:3.0:1787853339.030666:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853339.031195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853339.031285:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720832 00000100:00100000:1.0:1787853339.031291:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720832 00000100:00100000:1.0:1787853339.031327:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720192 00000100:00100000:1.0:1787853339.031329:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720192 00000100:00100000:1.0:1787853339.031338:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720960 00000100:00100000:1.0:1787853339.031340:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720960 00000100:00100000:1.0:1787853339.031354:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853339.031361:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491720832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.031401:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491720832:12345-0@lo:400:kworker.0 Request processed in 40us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.031407:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853339.031419:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853339.031425:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.031669:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491720192:12345-0@lo:400:kworker.0 Request processed in 243us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.031676:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853339.031689:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853339.031696:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874699491720960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853339.031727:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874699491720960:12345-0@lo:400:kworker.0 Request processed in 33us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.031732:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853339.031770:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720448 00000100:00100000:1.0:1787853339.031774:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720448 00000100:00100000:1.0:1787853339.031793:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720576 00000100:00100000:1.0:1787853339.031828:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720576 00000100:00100000:1.0:1787853339.031860:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853339.031865:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1874699491720448:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787853339.031891:0:24206:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:1.0:1787853339.031917:0:24206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af2fbe 00002000:00100000:1.0:1787853339.031932:0:24206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cfac45f4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787853339.031935:0:24206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787853339.031939:0:24206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787853339.032130:0:24206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787853339.032154:0:24206:0:(import.c:65:import_set_state_nolock()) ffff8cfac45f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853339.032196:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874699491720448:12345-0@lo:8:kworker.0 Request processed in 329us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.032203:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853339.032216:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853339.032220:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1874699491720576:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787853339.032230:0:24206:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787853339.034166:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491720704:0@lo:400:kworker.0 00000100:00100000:0.0:1787853339.034220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853339.034277:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491720704 00000100:00100000:0.0:1787853339.034283:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491720704 00000100:00100000:0.0:1787853339.034325:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853339.034333:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853339.034381:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491720704:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853339.034387:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787853339.034429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f6d00 x1874699491720704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853339.034443:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491720704:0@lo:400:kworker.0 00000100:00100000:0.0:1787853339.034508:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491720320:0@lo:400:kworker.0 00010000:00080000:0.0:1787853339.034534:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f61c0 x1874699491720192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853339.034543:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491720192:0@lo:400:kworker.0 00010000:00080000:0.0:1787853339.034559:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f6940 x1874699491720960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853339.034567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491720960:0@lo:400:kworker.0 00000100:00100000:0.0:1787853339.034578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491720064:0@lo:400:kworker.0 00010000:00080000:0.0:1787853339.034590:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f5a40 x1874699491720832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853339.034598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491720832:0@lo:400:kworker.0 00000100:00080000:0.0:1787853339.034867:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787853339.034872:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787853339.034922:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f4f00 x1874699491720448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853339.034931:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853339.034938:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787853339.034946:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787853339.034951:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787853339.034955:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfcd88800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787853339.034978:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787853339.034984:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491720448:0@lo:8:kworker.0 00000004:00080000:0.0:1787853339.035044:0:23441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787853339.035081:0:23441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721216:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787853339.035113:0:23441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853339.035131:0:23441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67be480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853339.035147:0:24204:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853339.035153:0:24204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787853339.035166:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491721088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853339.035189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853339.035315:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721216 00000100:00100000:0.0:1787853339.035319:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721216 00000100:00080000:0.0:1787853339.035355:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853339.035420:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853339.035427:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23441:x1874699491721216:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787853339.035762:0:23440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787853339.036029:0:23440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 677099186148ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787853339.036049:0:23440:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787853339.037330:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721088 00000100:00100000:2.0:1787853339.037343:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721088 00000100:00100000:2.0:1787853339.037390:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853339.037400:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874699491721088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787853339.037697:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491719936 00000100:00100000:3.0:1787853339.037702:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491719936 00000100:00100000:3.0:1787853339.037743:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853339.037752:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491719936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853339.038011:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491719936:12345-0@lo:400:kworker.0 Request processed in 258us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853339.038018:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853339.038082:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491719936:0@lo:400:kworker.0 00002000:00000024:2.0:1787853339.038701:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853339.038763:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874699491721088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1364us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853339.038772:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787853339.039178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f4f00 x1874699491721088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853339.039200:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491721088:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787853339.045540:0:23431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787853339.046514:0:24689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787853339.046521:0:24689:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787853339.046623:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23441:x1874699491721216:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11192us (11504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853339.046635:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787853339.046728:0:23441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f5a40 x1874699491721216/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787853355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853339.046743:0:23441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721216:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787853339.046757:0:23441:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787853339.046812:0:23441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721344:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787853339.046888:0:23441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853339.046914:0:23441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853339.047080:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721344 00000100:00100000:0.0:1787853339.047087:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721344 00000100:00100000:0.0:1787853339.050120:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853339.050143:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23441:x1874699491721344:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787853339.050181:0:24204:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787853339.050268:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23441:x1874699491721344:12345-0@lo:5:osp-pre-0-1.0 Request processed in 136us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853339.050276:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787853339.054208:0:23441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b0000 x1874699491721344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853339.054240:0:23441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721344:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787853339.054256:0:23441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787853339.054303:0:23441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721472:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787853339.054360:0:23441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853339.054390:0:23441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853339.054420:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721472 00000100:00100000:2.0:1787853339.054427:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721472 00000100:00100000:2.0:1787853339.054480:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853339.054489:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23441:x1874699491721472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787853339.054529:0:24207:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1787853339.078060:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1874699491720576:12345-0@lo:8:kworker.0 Request processed in 45828us (47383us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853339.078075:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787853339.078158:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853339.078163:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787853339.078167:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491720576:0@lo:8:kworker.0 00000001:00080000:1.0:1787853339.100761:0:24201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787853339.100779:0:24201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787853339.107868:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23441:x1874699491721472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 53370us (53498us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787853339.107883:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787853339.108115:0:23441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b0000 x1874699491721472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853355 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853339.108128:0:23441:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787853339.108134:0:23441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23441:1874699491721472:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787853339.108149:0:23441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1787853339.108195:0:23441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23441:1874699491721600:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787853339.108226:0:23441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853339.108247:0:23441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf631cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853339.108364:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721600 00000100:00100000:1.0:1787853339.108370:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721600 00000100:00100000:1.0:1787853339.108409:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853339.108417:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23441:x1874699491721600:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787853339.108594:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23441:x1874699491721600:12345-0@lo:900:osp-pre-0-1.0 Request processed in 176us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853339.108609:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787853339.108667:0:23441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b0000 x1874699491721600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787853355 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853339.108678:0:23441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23441:1874699491721600:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787853339.536411:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853340.305456:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853340.305480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491721728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853340.305547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853340.306269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853340.306316:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721728 00000100:00100000:1.0:1787853340.306324:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721728 00000100:00100000:3.0:1787853340.309590:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491721856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853340.309669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853340.318209:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721856 00000100:00100000:1.0:1787853340.318224:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721856 00000100:00100000:1.0:1787853340.318411:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853340.318424:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491721728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787853340.318465:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853340.319905:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491721728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1478us (14350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853340.319920:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491721728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853340.319921:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787853340.319957:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787853340.319970:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491721856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853340.319997:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853340.320061:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491721856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (10392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853340.320068:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853340.320270:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491721856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787853340.561309:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853341.586570:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853342.160465:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853342.610942:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853343.644908:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853344.400047:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853344.400072:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491721984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853344.400152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853344.400220:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491721984 00000100:00100000:2.0:1787853344.400228:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491721984 00000100:00100000:2.0:1787853344.400285:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853344.400294:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491721984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787853344.400323:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853344.400367:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491721984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853344.400373:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787853344.400392:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853344.400419:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b12c0 x1874699491721984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853344.400436:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491721984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853344.409102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853344.409125:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491722112:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.409197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853344.409294:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722112 00000100:00100000:2.0:1787853344.409301:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722112 00000100:00100000:2.0:1787853344.409345:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787853344.409353:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.409405:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491722112:12345-0@lo:400:kworker.0 Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853344.409412:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787853344.409455:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491722112:0@lo:400:kworker.0 00000100:00080000:2.0:1787853344.409500:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853344.409505:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853344.409507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853344.409510:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853344.409518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491722240:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.409547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853344.409576:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722240 00000100:00100000:2.0:1787853344.409580:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722240 00000100:00100000:2.0:1787853344.409603:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787853344.409609:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.409643:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491722240:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853344.409649:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787853344.409672:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491722240:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.409703:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491722368:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.410306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787853344.411307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853344.411313:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787853344.411317:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853344.411324:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:2.0:1787853344.411329:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787853344.411336:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853344.411345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853344.411363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491722496:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.411405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853344.411436:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722496 00000100:00100000:2.0:1787853344.411442:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722496 00000100:00100000:2.0:1787853344.411480:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853344.411488:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491722496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.411533:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491722496:12345-0@lo:400:kworker.0 Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853344.411541:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853344.411576:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491722496:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.411611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32e940 x1874699491722624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853344.411637:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491722624:0@lo:8:kworker.0 00000100:00100000:2.0:1787853344.411683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853344.411712:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722624 00000100:00100000:2.0:1787853344.411716:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722624 00000100:00100000:2.0:1787853344.411734:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853344.411739:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1874699491722624:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787853344.411758:0:24204:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787853344.411789:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1874699491722624:12345-0@lo:8:kworker.0 Request processed in 49us (106us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787853344.411795:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787853344.411820:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853344.411824:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787853344.411827:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491722624:0@lo:8:kworker.0 00000100:00100000:2.0:1787853344.411879:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491722752:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.411911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853344.414395:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853344.414415:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491723008:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.418914:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853344.418932:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491722880:0@lo:400:kworker.0 00000100:00100000:2.0:1787853344.419093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853344.419179:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722368 00000100:00100000:0.0:1787853344.419188:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722368 00000100:00100000:1.0:1787853344.419264:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722752 00000100:00100000:1.0:1787853344.419268:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722752 00000100:00100000:1.0:1787853344.419308:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853344.419317:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491722368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853344.419367:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491722368:12345-0@lo:400:kworker.0 Request processed in 52us (9064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853344.419374:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853344.419392:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787853344.419410:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491722752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853344.419440:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491722752:12345-0@lo:400:kworker.0 Request processed in 31us (7529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853344.419446:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787853344.419579:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491722880 00000100:00100000:1.0:1787853344.419583:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491722880 00000100:00100000:1.0:1787853344.419617:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787853344.419623:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853344.419998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787853344.420119:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfc32e940 x1874699491722752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853344.420140:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491722752:0@lo:400:kworker.0 00000100:00100000:0.0:1787853344.420157:0:22700:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853344.420165:0:22700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1787853344.420179:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbf60b12c0 x1874699491722368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853344.420189:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491722368:0@lo:400:kworker.0 00000100:00100000:1.0:1787853344.420382:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491722880:12345-0@lo:400:kworker.0 Request processed in 758us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853344.420389:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787853344.420401:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723008 00000100:00100000:1.0:1787853344.420404:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723008 00000100:00100000:1.0:1787853344.420423:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787853344.420429:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491723008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853344.420464:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491723008:12345-0@lo:400:kworker.0 Request processed in 35us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853344.420470:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787853344.420488:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853344.420492:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787853344.420509:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbd558e1c0 x1874699491723008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853344.420518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491723008:0@lo:400:kworker.0 00010000:00080000:3.0:1787853344.421019:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbd558de00 x1874699491722880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853344.421030:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491722880:0@lo:400:kworker.0 00010000:00010000:0.0:1787853344.655956:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853345.424520:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491723136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853345.424594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.424647:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723136 00000100:00100000:3.0:1787853345.424654:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723136 00000100:00100000:3.0:1787853345.424698:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853345.424707:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491723136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787853345.424740:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853345.424786:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491723136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.424793:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853345.424875:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491723136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787853345.425429:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491723264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787853345.425467:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.425580:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853325/real 1787853325] req@ffff8cfac4c06d00 x1874699491713920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853345.425601:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfac4c06d00 x1874699491713920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853345.425611:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853325/real 1787853325] req@ffff8cfac4c07c00 x1874699491714048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853345.425622:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfac4c07c00 x1874699491714048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853345.425633:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853345.425657:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853345.425671:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491713920:0@lo:8:kworker.0 00000100:00080000:3.0:1787853345.425677:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853345.425683:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853345.425685:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491714048:0@lo:8:kworker.0 00000100:00080000:2.0:1787853345.427129:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853345.427136:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787853345.427139:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853345.427146:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:2.0:1787853345.427151:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787853345.427159:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfbd2304800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853345.427178:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32cb40 x1874699491723520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853345.427194:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853345.427198:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787853345.427199:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853345.427202:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:2.0:1787853345.427212:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787853345.427216:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfbfdcb2800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853345.427229:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfc32f0c0 x1874699491723648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853345.427258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853345.427261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787853345.427263:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853345.427266:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:2.0:1787853345.427268:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787853345.427271:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1787853345.427281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbf60b12c0 x1874699491724032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853345.427330:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491723392:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427442:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491724288:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427493:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853345.427500:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427546:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491723520:0@lo:8:kworker.0 00000100:00100000:2.0:1787853345.427571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427587:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491723648:0@lo:8:kworker.0 00000100:00100000:2.0:1787853345.427622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427639:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491724032:0@lo:8:kworker.0 00000100:00100000:2.0:1787853345.427669:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427696:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491723776:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427736:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491724416:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427773:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853345.427779:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491723904:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.427800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.427833:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723392 00000100:00100000:2.0:1787853345.427861:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723392 00000100:00100000:2.0:1787853345.427907:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787853345.427916:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491723392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428263:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:3646:x1874699491723392:12345-0@lo:400:kworker.0 Request processed in 58us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428273:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787853345.428314:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724288 00000100:00100000:2.0:1787853345.428319:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724288 00000100:00100000:2.0:1787853345.428340:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724160 00000100:00100000:2.0:1787853345.428343:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724160 00000100:00100000:2.0:1787853345.428355:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723776 00000100:00100000:2.0:1787853345.428357:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723776 00000100:00100000:2.0:1787853345.428367:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724416 00000100:00100000:2.0:1787853345.428370:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724416 00000100:00100000:2.0:1787853345.428382:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853345.428388:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491724288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428426:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491724288:12345-0@lo:400:kworker.0 Request processed in 38us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428443:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853345.428458:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853345.428464:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491724160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428495:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491724160:12345-0@lo:400:kworker.0 Request processed in 32us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428500:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853345.428512:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853345.428518:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491723776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428551:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491723776:12345-0@lo:400:kworker.0 Request processed in 33us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428557:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853345.428569:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787853345.428575:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874699491724416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428601:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874699491724416:12345-0@lo:400:kworker.0 Request processed in 26us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428606:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787853345.428626:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723520 00000100:00100000:2.0:1787853345.428630:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723520 00000100:00100000:2.0:1787853345.428641:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723648 00000100:00100000:2.0:1787853345.428644:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723648 00000100:00100000:2.0:1787853345.428651:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724032 00000100:00100000:2.0:1787853345.428653:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724032 00000100:00100000:2.0:1787853345.428659:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723904 00000100:00100000:2.0:1787853345.428661:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723904 00000100:00100000:2.0:1787853345.428675:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853345.428682:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491723904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.428721:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491723904:12345-0@lo:400:kworker.0 Request processed in 40us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.428728:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853345.428740:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853345.428744:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1874699491723520:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787853345.428769:0:24204:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:2.0:1787853345.428808:0:24204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af2fc5 00002000:00100000:2.0:1787853345.428821:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cfbfe312000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787853345.428825:0:24204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787853345.428828:0:24204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787853345.428946:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787853345.428970:0:24204:0:(import.c:65:import_set_state_nolock()) ffff8cfbfe316800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853345.429132:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853345.429138:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1874699491723648:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787853345.429150:0:24207:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853345.429190:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1874699491723648:12345-0@lo:8:kworker.0 Request processed in 51us (1567us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787853345.429196:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853345.429208:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853345.429211:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1874699491724032:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787853345.429221:0:24207:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787853345.429238:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1874699491724032:12345-0@lo:8:kworker.0 Request processed in 26us (1569us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787853345.429243:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853345.431287:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874699491723520:12345-0@lo:8:kworker.0 Request processed in 2536us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.431299:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787853345.431377:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbd29a8000 x1874699491724160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491724160:0@lo:400:kworker.0 00000100:00100000:2.0:1787853345.431406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3646:1874699491723392:0@lo:400:kworker.0 00010000:00080000:2.0:1787853345.431417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbd29ab480 x1874699491724288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431425:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491724288:0@lo:400:kworker.0 00010000:00080000:2.0:1787853345.431464:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfc32c000 x1874699491723904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431485:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491723904:0@lo:400:kworker.0 00010000:00080000:2.0:1787853345.431497:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfc32f480 x1874699491723776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431504:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491723776:0@lo:400:kworker.0 00010000:00080000:2.0:1787853345.431514:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbcaf052c0 x1874699491724416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431521:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1874699491724416:0@lo:400:kworker.0 00010000:00080000:2.0:1787853345.431571:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfc32cb40 x1874699491723520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853345.431579:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853345.431586:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787853345.431594:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787853345.431599:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787853345.431602:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbd2304800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787853345.431619:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787853345.431624:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491723520:0@lo:8:kworker.0 00000100:00080000:2.0:1787853345.431637:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853345.431640:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787853345.431643:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491723648:0@lo:8:kworker.0 00000100:00080000:2.0:1787853345.431652:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853345.431655:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787853345.431658:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf60b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491724032:0@lo:8:kworker.0 00000004:00080000:1.0:1787853345.431892:0:22723:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1787853345.431914:0:22723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22723:1874699491724672:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787853345.431970:0:22723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853345.432003:0:22723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc50089c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787853345.432021:0:22722:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787853345.432243:0:22722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683495400553ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787853345.432251:0:22722:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787853345.432276:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724672 00000100:00100000:1.0:1787853345.432283:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724672 00000100:00100000:1.0:1787853345.432326:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853345.432334:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22723:x1874699491724672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787853345.433825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491724544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853345.433901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.434745:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724544 00000100:00100000:2.0:1787853345.434755:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724544 00000100:00100000:2.0:1787853345.434816:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853345.434826:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874699491724544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853345.434867:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853345.434942:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874699491724544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.434950:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853345.436153:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491723264 00000100:00100000:0.0:1787853345.436163:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491723264 00010000:00080000:3.0:1787853345.437293:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfbd92580 x1874699491724544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853345.437319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491724544:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787853345.439267:0:24207:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787853345.439282:0:24207:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787853345.439289:0:24207:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:0.0:1787853345.442077:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787853345.442231:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491723264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787853345.442275:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787853345.442377:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491723264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (16908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.442385:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:3.0:1787853345.443234:0:22678:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787853345.443789:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491723264:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787853345.443951:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787853345.460341:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.460353:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.460390:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.460395:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.460402:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.460420:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.460431:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.460439:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.460467:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853345.460734:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853345.460783:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.460793:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.460798:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.460807:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.460833:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.460899:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bf63884/0xe2bf4b958af2fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.460919:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.460933:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.460935:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853345.461801:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.461810:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.461822:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.461826:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.461832:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.461869:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.461892:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.461899:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.461916:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853345.462426:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853345.462433:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.462442:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.462446:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.462455:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.462468:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.462474:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4e6aa6/0xe2bf4b958af2fd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.462501:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.462504:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.462505:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853345.462593:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.462600:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.462609:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.462612:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.462617:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.462626:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.462634:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.462641:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.462672:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787853345.463202:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.463208:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.463218:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.463221:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.463225:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.463235:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.463242:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.463248:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.464171:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787853345.466498:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.466513:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.466531:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.466545:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.466552:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.466566:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.466576:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.466584:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471790:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853345.471807:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471822:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.471827:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471839:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471884:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471893:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de6d6c5d/0xe2bf4b958af2fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471940:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853345.471944:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471951:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.471955:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471964:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471986:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.471994:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b1d0138/0xe2bf4b958af2fe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.472008:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.472012:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.472019:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.472023:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.472042:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.472053:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.472061:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.472063:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.472065:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.472384:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.475817:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853345.475833:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2fe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.476703:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853345.479769:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.479791:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.479809:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.479814:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.479820:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.479835:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.480147:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.480155:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.480231:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787853345.482932:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.482946:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.482963:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.482969:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.484064:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.484086:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.484096:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.484103:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488860:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853345.488889:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488903:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.488907:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488918:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488951:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488959:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a03be1f/0xe2bf4b958af2fef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488987:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853345.488991:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.488997:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.489009:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.489016:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.489025:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.489032:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.489033:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.489035:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.496965:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853345.496989:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af2ff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853345.503205:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.503232:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.503252:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.503257:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.503264:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.503280:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.503290:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.503298:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.513970:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.513995:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.514012:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.514018:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.514029:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.514052:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.514064:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.514066:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.514075:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.516998:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853345.517016:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003344e87/0xe2bf4b958af2ffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853345.518304:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853345.518319:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.518340:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1787853345.518345:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853345.518353:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.518369:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.518381:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.518388:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.518816:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853345.518824:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.518834:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.518839:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.518887:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.518906:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.518916:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.518937:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.518940:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.519120:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787853345.519126:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089bd7130/0xe2bf4b958af3004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.519785:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.519793:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.519804:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.519808:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.519814:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.519824:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.519832:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.519839:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.520065:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.520073:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.520082:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.520087:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.520096:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.520110:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.520120:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.520122:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.520124:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.520319:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.520325:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af300b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.520776:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.520782:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.520804:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.520808:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.520813:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.520823:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.520831:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.520838:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.520933:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.520940:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.520960:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.520965:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.520981:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.520993:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.521002:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.521004:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.521006:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.521159:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.521164:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3012 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.521834:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.521874:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.521888:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.521892:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.521897:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.521931:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.521941:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.521948:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.522109:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.522116:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.522124:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.522128:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.522136:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.522161:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.522171:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.522172:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.522174:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.522376:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.522382:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.522791:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.522797:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.522808:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.522812:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.522817:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.522827:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.522875:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.522882:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.522942:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.522949:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.522956:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.522960:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.522968:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.523074:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.523089:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.523090:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.523092:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.523165:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.523171:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3020 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.523590:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.523596:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.523605:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.523608:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.523612:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.523620:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.523628:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.523645:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.523672:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.523677:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.523740:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1488400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.523745:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.523753:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.523765:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.523774:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.523775:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.523777:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.523866:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.523872:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d36c93ab/0xe2bf4b958af3027 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.524505:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.524512:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.524521:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.524524:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.524529:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.524539:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.524547:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.524554:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.524669:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.524677:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.524693:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1489200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.524697:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.524706:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.524719:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.524728:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.524729:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.524731:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.526784:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.526801:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa443efe/0xe2bf4b958af302e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.528133:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.528145:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.528161:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.528166:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.528171:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.528185:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.528195:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.528202:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.528825:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.528835:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.528877:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1489400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.528883:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.528894:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.528915:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.528933:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.528935:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.528937:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.529130:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.529137:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b05a9f8/0xe2bf4b958af3035 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.529782:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.529789:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.529800:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.529804:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.529810:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.529821:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.529830:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.529838:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.530062:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.530070:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.530078:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1489600 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.530082:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.530100:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.530114:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.530123:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.530124:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.530126:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.530194:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.530199:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009429c375/0xe2bf4b958af303c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.530645:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.530651:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.530670:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.530673:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.530678:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.530698:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.530706:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.530713:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.530780:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.530785:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.530793:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1488800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.530796:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.530805:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.530817:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.530830:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.530832:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.530834:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.531119:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.531124:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080784863/0xe2bf4b958af3043 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.531747:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.531754:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.531764:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.531768:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.531772:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.531794:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.531802:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.531818:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.532177:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.532184:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.532193:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc1489c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.532197:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.532207:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.532231:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.532241:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.532242:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.532244:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.532562:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.532569:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff60fac0/0xe2bf4b958af304a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.533033:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.533039:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533049:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.533052:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.533057:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533066:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533085:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533093:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533113:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853345.533471:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.533478:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.533486:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.533489:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.533498:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.533511:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.533519:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b0ddce/0xe2bf4b958af3051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.533538:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.533539:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.533541:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853345.533616:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.533622:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533630:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.533633:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.533637:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533646:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533655:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533662:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.533745:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853345.534084:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.534091:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534100:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.534103:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.534107:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534116:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534124:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534132:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534141:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853345.534529:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853345.534537:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534544:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.534547:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534556:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534569:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534575:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71f0d3e/0xe2bf4b958af3058 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534591:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.534595:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534601:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.534609:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534616:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534626:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534633:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af305f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.534645:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.534647:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.534648:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853345.534790:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.534796:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534805:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.534814:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.534819:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534829:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534837:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534874:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.534885:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853345.535094:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.535100:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.535107:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.535110:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.535129:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.535139:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.535146:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bbe2f05/0xe2bf4b958af3066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.535161:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.535163:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.535164:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853345.535481:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.535488:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.535498:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.535502:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.535506:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.535516:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.535525:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.535538:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.535594:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853345.535967:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.536045:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.536054:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.536058:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.536062:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.536072:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.536080:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.536088:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536495:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787853345.536504:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536514:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.536518:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536528:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536544:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536569:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cef67ff/0xe2bf4b958af306d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536589:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853345.536593:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536600:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853345.536604:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536611:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536622:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.536630:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.536631:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853345.536633:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853345.536786:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853345.536792:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cde2b7bd/0xe2bf4b958af3074 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853345.537258:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.537264:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537274:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.537277:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.537283:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537293:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537302:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537309:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537319:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853345.537624:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.537631:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.537639:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.537642:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.537652:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.537664:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.537679:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059481d7b/0xe2bf4b958af307b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.537755:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.537757:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.537758:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853345.537887:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.537894:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537903:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.537907:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.537917:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537940:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537948:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537955:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.537968:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853345.538353:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.538359:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538368:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.538371:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.538376:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538385:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538393:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538411:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538420:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787853345.538739:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.538746:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538754:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.538758:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.538762:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538771:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538780:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538787:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.538796:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787853345.539125:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853345.539131:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539139:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.539144:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539152:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539165:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539173:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eb5bb3c/0xe2bf4b958af3082 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539191:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853345.539194:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539208:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95a00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.539223:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539231:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539242:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539249:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000706c008f/0xe2bf4b958af3089 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539263:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.539266:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539273:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95600 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.539276:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539283:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539292:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539305:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d301d5da/0xe2bf4b958af3090 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.539318:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.539320:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.539322:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853345.539478:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.539484:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.539498:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.539501:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.539505:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.539515:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.539523:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.539530:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.539552:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853345.539967:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853345.540043:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.540053:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1787853345.540056:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853345.540060:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.540068:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.540088:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.540094:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.540103:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1787853345.540133:0:24207:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1787853345.540439:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853345.540446:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540454:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.540457:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540466:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540477:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540483:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c44f0d67/0xe2bf4b958af3097 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540499:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.540502:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540517:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853345.540521:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540528:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540540:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540546:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000887f8e80/0xe2bf4b958af309e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.540564:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.540566:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.540568:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853345.540627:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22723:x1874699491724672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108288us (108651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.540638:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787853345.540788:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853345.540828:0:22723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22723:1874699491724672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787853345.541086:0:22723:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1787853345.541204:0:22723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf05680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22723:1874699491724800:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787853345.541363:0:22723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.541429:0:22723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbd8d75a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853345.541477:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724800 00000100:00100000:0.0:1787853345.541484:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724800 00000100:00100000:0.0:1787853345.541558:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853345.541570:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22723:x1874699491724800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787853345.541612:0:24689:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1787853345.564576:0:24201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787853345.564623:0:24201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787853345.564877:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22723:x1874699491724800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23276us (23480us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787853345.564890:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853345.565016:0:22723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787853345.565036:0:22723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf05680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22723:1874699491724800:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787853345.565053:0:22723:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:0.0:1787853345.577557:0:25021:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787853345.577561:0:25021:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787853345.577563:0:25021:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787853345.578371:0:25021:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfac4504000 00000020:01000004:0.0:1787853345.578391:0:25021:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787853345.578407:0:25021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787853345.578422:0:25021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cfbe0258000) 00000020:00000080:0.0:1787853345.578440:0:25021:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787853345.667893:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787853345.668940:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787853345.669480:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787853345.670098:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787853345.670784:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787853345.672440:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787853345.674822:0:25021:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:2.0:1787853345.681220:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:1.0:1787853345.682610:0:25021:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787853345.683379:0:25021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787853345.683401:0:25021:0:(osd_handler.c:8928:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787853345.686897:0:25021:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2bf4b958af30ac 00000020:01000004:2.0:1787853345.686915:0:25021:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787853345.686983:0:25021:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787853345.686988:0:25021:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787853345.686997:0:25021:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787853345.687038:0:25021:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787853345.687042:0:25021:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787853345.710754:0:25021:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787853345.710796:0:25021:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787853345.710801:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787853345.710803:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853345.710805:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853345.710806:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853345.710807:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853345.710809:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853345.710811:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853345.710813:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853345.710814:0:25021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853345.710817:0:25021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787853345.710820:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853345.710821:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853345.710822:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853345.710823:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853345.710824:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853345.710826:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853345.710827:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853345.710828:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853345.710829:0:25021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853345.711072:0:25021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787853345.711167:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491724928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787853345.711246:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.711351:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb69eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.711444:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491724928 00000100:00100000:3.0:1787853345.711450:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491724928 00000100:00100000:3.0:1787853345.711505:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787853345.711515:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:25021:x1874699491724928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787853345.711545:0:22691:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787853345.711548:0:22691:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787853345.711552:0:22691:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787853345.712068:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:25021:x1874699491724928:12345-0@lo:253:mount.lustre.0 Request processed in 553us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.712086:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787853345.712208:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491724928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787853345.712221:0:25021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787853345.712224:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853345.712225:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853345.712227:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853345.712228:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853345.712229:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853345.712230:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853345.712232:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853345.712233:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853345.712234:0:25021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787853345.712261:0:25021:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfac4504000 from lustre-OST0001 10000000:01000000:0.0:1787853345.712293:0:25021:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787853345.712296:0:25021:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787853345.712304:0:25021:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfbf7154d70 local copy 00010000:00010000:0.0:1787853345.712421:0:25021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.712503:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853345.712537:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.712618:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc62e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853345.712651:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725056 00000100:00100000:2.0:1787853345.712657:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725056 00000100:00100000:2.0:1787853345.712737:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787853345.712746:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:25021:x1874699491725056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853345.712820:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:25021:x1874699491725056:12345-0@lo:501:mount.lustre.0 Request processed in 75us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853345.712827:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787853345.712945:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725056:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787853345.712956:0:25021:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787853345.712984:0:25021:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787853345.712990:0:25021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.712998:0:25021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb000/0xe2bf4b958af2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af2ced expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853345.713024:0:25021:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfac4504000 10000000:01000000:0.0:1787853345.713028:0:25021:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787853345.713033:0:25021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787853345.713035:0:25021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853345.713039:0:25021:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787853345.713042:0:25021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787853345.713061:0:25021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.713070:0:25021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.713097:0:25021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.713110:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853345.713138:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.713611:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725184 00000100:00100000:3.0:1787853345.713617:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725184 00000100:00100000:3.0:1787853345.713641:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787853345.713648:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:25021:x1874699491725184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853345.713660:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853345.713674:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af30ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af30b3 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.713717:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af30ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af30b3 expref: 22 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.713727:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfccca400/0xe2bf4b958af30ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af30b3 expref: 22 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.713736:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfccca400, rc 0) 00000100:00100000:3.0:1787853345.713761:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725184:12345-0@lo:101:mount.lustre.0 Request processed in 114us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.713767:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787853345.714151:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc62e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.714169:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853345.714182:0:25021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30ba expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.714192:0:25021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af30ba expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853345.715178:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787853345.715658:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853345.722422:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787853345.722481:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787853345.722495:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787853345.722508:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787853345.722520:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787853345.722534:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787853345.722547:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787853345.722570:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787853345.722583:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787853345.722609:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787853345.722615:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787853345.723441:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853345.723514:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853345.723572:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc8702900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.724417:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725312 00000100:00100000:3.0:1787853345.724427:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725312 00000100:00100000:3.0:1787853345.724481:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787853345.724491:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853345.724662:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725312:12345-0@lo:501:mount.lustre.0 Request processed in 173us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.724670:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787853345.724835:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853345.725196:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853345.725257:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.730275:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6716840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.731463:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725440 00000100:00100000:3.0:1787853345.731474:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725440 00000100:00100000:0.0:1787853345.732583:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787853345.732603:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853345.733687:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725440:12345-0@lo:503:mount.lustre.0 Request processed in 1078us (8416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.733699:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787853345.733887:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853345.734556:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853345.734651:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853345.734910:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.735011:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc545a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.735222:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725568 00000100:00100000:3.0:1787853345.735229:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725568 00000100:00100000:3.0:1787853345.735261:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787853345.735269:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853345.735739:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725568:12345-0@lo:502:mount.lustre.0 Request processed in 470us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.735748:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787853345.735949:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853345.736330:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787853345.736361:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787853345.736376:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787853345.736391:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787853345.736415:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787853345.736430:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787853345.736443:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787853345.736457:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787853345.736471:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787853345.736503:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853345.736548:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.736621:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6716840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853345.740209:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725696 00000100:00100000:0.0:1787853345.740224:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725696 00000100:00100000:0.0:1787853345.740290:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787853345.740302:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853345.740566:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725696:12345-0@lo:502:mount.lustre.0 Request processed in 267us (4018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.740574:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787853345.740786:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853345.744158:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1787853345.744182:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787853345.745581:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787853345.745591:0:25025:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787853345.745598:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853345.745600:0:25025:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787853345.745605:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853345.745620:0:25025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cfbe60833a0) 00000020:00000080:1.0:1787853345.745644:0:25025:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787853345.745650:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787853345.745798:0:25025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac4504000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787853345.745807:0:25025:0:(osd_handler.c:8928:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787853345.745816:0:25025:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2bf4b958af30c8 00010000:00010000:0.0:1787853345.753064:0:25025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787853345.753672:0:25025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1787853345.757260:0:25025:0:(osd_handler.c:5584:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787853345.758911:0:25025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787853345.758933:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853345.758939:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853345.758942:0:25025:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787853345.758945:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853345.758949:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853345.758957:0:25025:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787853345.758961:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787853345.758963:0:25025:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787853345.758966:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853345.758980:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853345.758981:0:25025:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787853345.758984:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853345.758987:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853345.758988:0:25025:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787853345.758991:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787853345.759016:0:25025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853345.759019:0:25025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853345.759020:0:25025:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787853345.759023:0:25025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787853345.759532:0:25021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787853345.759571:0:25021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787853345.759594:0:25021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30ba expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.759607:0:25021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94c00/0xe2bf4b958af30b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30ba expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853345.759616:0:25021:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac4504000 from 1 10000000:01000000:3.0:1787853345.759619:0:25021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853345.759658:0:25021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.759666:0:25021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.759685:0:25021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853345.759710:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853345.759791:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.759876:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1787853345.759943:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725824 00000100:00100000:2.0:1787853345.759951:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725824 00000100:00100000:2.0:1787853345.760014:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787853345.760022:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491725824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853345.760035:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853345.760047:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af30cf expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.760069:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.760090:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.760100:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794a00, rc 0) 00000100:00100000:2.0:1787853345.760137:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491725824:12345-0@lo:101:mount.lustre.0 Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.760145:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787853345.760431:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853345.760445:0:25021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.760468:0:25021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853345.764260:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787853345.764585:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853345.764893:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787853345.764952:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787853345.764984:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787853345.765002:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787853345.765017:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787853345.765030:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787853345.765044:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787853345.765056:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787853345.765071:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787853345.765818:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787853345.765837:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787853345.766152:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787853345.766159:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787853345.766264:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853345.766772:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.766902:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853345.777137:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491725952 00000100:00100000:2.0:1787853345.777152:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491725952 00000100:00100000:2.0:1787853345.777261:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787853345.777272:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491725952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853345.777471:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491725952:12345-0@lo:501:mount.lustre.0 Request processed in 201us (10699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.777481:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787853345.777566:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491725952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853345.777616:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853345.777672:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.780211:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.780285:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726080 00000100:00100000:1.0:1787853345.780294:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726080 00000100:00100000:0.0:1787853345.780474:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787853345.780485:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853345.780681:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726080:12345-0@lo:503:mount.lustre.0 Request processed in 196us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.780689:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787853345.780782:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853345.781240:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853345.781329:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853345.781375:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.781409:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.781501:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726208 00000100:00100000:1.0:1787853345.781507:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726208 00000100:00100000:1.0:1787853345.781543:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787853345.781551:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853345.781638:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726208:12345-0@lo:502:mount.lustre.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853345.781645:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787853345.781749:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853345.781975:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787853345.782002:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787853345.782019:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787853345.782033:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787853345.782047:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787853345.782077:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787853345.782094:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787853345.782107:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787853345.782119:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787853345.782132:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787853345.782146:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787853345.782167:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853345.782206:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.782235:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.782288:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726336 00000100:00100000:1.0:1787853345.782292:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726336 00000100:00100000:1.0:1787853345.782323:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787853345.782330:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853345.782410:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726336:12345-0@lo:502:mount.lustre.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853345.782417:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787853345.782517:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853345.782553:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787853345.782561:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787853345.783315:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853345.783324:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.783327:0:25029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787853345.783333:0:25029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac4504000 00000020:00000080:2.0:1787853345.783336:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787853345.783344:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853345.783346:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.783348:0:25029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787853345.783350:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853345.783353:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.783354:0:25029:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787853345.783358:0:25029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfac4504000 00000020:00000080:2.0:1787853345.783360:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787853345.783443:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853345.783447:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.783448:0:25029:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787853345.783451:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853345.783454:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.783455:0:25029:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787853345.783458:0:25029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac4504000 00000020:00000080:2.0:1787853345.783460:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787853345.792034:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853345.792121:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.792124:0:25029:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787853345.792130:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853345.792135:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.792137:0:25029:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787853345.792141:0:25029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfac4504000 00000020:00000080:2.0:1787853345.792144:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787853345.792214:0:25029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853345.792218:0:25029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853345.792220:0:25029:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787853345.792223:0:25029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787853345.792803:0:25021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787853345.792837:0:25021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853345.796533:0:25021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.796547:0:25021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853345.796634:0:25021:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787853345.796637:0:25021:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfac4504000 10000000:01000000:3.0:1787853345.796640:0:25021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfac4504000 10000000:01000000:3.0:1787853345.796644:0:25021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853345.796650:0:25021:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfac4504000 from 1 10000000:01000000:3.0:1787853345.796653:0:25021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853345.796691:0:25021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.796699:0:25021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.796709:0:25021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853345.796733:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853345.796803:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.796868:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc62e29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.796901:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726464 00000100:00100000:3.0:1787853345.796907:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726464 00000100:00100000:3.0:1787853345.796962:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787853345.796970:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:25021:x1874699491726464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853345.796982:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853345.796995:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af30e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af30dd expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.797017:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af30e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af30dd expref: 24 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.797040:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfcccae00/0xe2bf4b958af30e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af30dd expref: 24 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.797048:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcccae00, rc 0) 00000100:00100000:3.0:1787853345.797085:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726464:12345-0@lo:101:mount.lustre.0 Request processed in 116us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.797093:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787853345.797142:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853345.797155:0:25021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30e4 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853345.797163:0:25021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af30e4 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853345.801281:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787853345.801634:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853345.805964:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787853345.806037:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787853345.806055:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787853345.806070:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787853345.806084:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787853345.806098:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787853345.806110:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787853345.806122:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787853345.806136:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787853345.806149:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787853345.806160:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787853345.806172:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787853345.806184:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787853345.806207:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787853345.806219:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787853345.806230:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787853345.806243:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787853345.806269:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787853345.806284:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787853345.806298:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787853345.807434:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787853345.807470:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787853345.807486:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787853345.807501:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787853345.807516:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787853345.807531:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787853345.807546:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787853345.807563:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787853345.807577:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787853345.807592:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787853345.807605:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787853345.807621:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787853345.807637:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787853345.808449:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787853345.808486:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787853345.808501:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787853345.808513:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787853345.808526:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787853345.808539:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787853345.808553:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787853345.808564:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787853345.808577:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787853345.808588:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787853345.808600:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787853345.808612:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787853345.808625:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787853345.808649:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787853345.808661:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787853345.810170:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787853345.810196:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787853345.810213:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787853345.810218:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787853345.811981:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853345.812057:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.812101:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc62e29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853345.812176:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726592 00000100:00100000:0.0:1787853345.812184:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726592 00000100:00100000:0.0:1787853345.812237:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787853345.812247:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853345.812384:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726592:12345-0@lo:501:mount.lustre.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.812392:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787853345.813008:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853345.813058:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853345.813110:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.813141:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc62e29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.813158:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726720 00000100:00100000:3.0:1787853345.813164:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726720 00000100:00100000:3.0:1787853345.813194:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787853345.813201:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853345.813292:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726720:12345-0@lo:503:mount.lustre.0 Request processed in 91us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.813300:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787853345.813359:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853345.814000:0:25021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853345.814073:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853345.814127:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853345.814166:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2fbe000 going to sleep for 11 seconds 00000100:00100000:3.0:1787853345.814185:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726848 00000100:00100000:3.0:1787853345.814196:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726848 00000100:00100000:3.0:1787853345.814224:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787853345.814231:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853345.815878:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726848:12345-0@lo:502:mount.lustre.0 Request processed in 1640us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853345.815890:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787853345.823901:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853345.824163:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787853345.824193:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787853345.824218:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787853345.824232:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787853345.824244:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787853345.824256:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787853345.824267:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787853345.824278:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787853345.824292:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787853345.824749:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787853345.824775:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787853345.824788:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787853345.824801:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787853345.824816:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787853345.824828:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787853345.825041:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787853345.825063:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787853345.825078:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787853345.825091:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787853345.825103:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787853345.825116:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787853345.825129:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787853345.825142:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787853345.825155:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787853345.825168:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787853345.825182:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787853345.825197:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787853345.825211:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787853345.825225:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787853345.825256:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787853345.825271:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787853345.825283:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787853345.825296:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787853345.825464:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787853345.825483:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787853345.825506:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787853345.825520:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787853345.825535:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787853345.825549:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787853345.825561:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787853345.825575:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787853345.825589:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787853345.825602:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787853345.825616:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787853345.825630:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787853345.825660:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787853345.825675:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787853345.825769:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787853345.825828:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853345.826537:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.826642:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2e36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853345.831251:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491726976 00000100:00100000:2.0:1787853345.831271:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491726976 00000100:00100000:2.0:1787853345.831353:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787853345.831364:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853345.831550:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491726976:12345-0@lo:502:mount.lustre.0 Request processed in 187us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.831558:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787853345.831838:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491726976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853345.832107:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787853345.832135:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787853345.832173:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491727104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853345.832226:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.832272:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2e36f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.832351:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727104 00000100:00100000:1.0:1787853345.832357:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727104 00000100:00100000:1.0:1787853345.832389:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787853345.832396:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491727104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853345.832479:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491727104:12345-0@lo:502:mount.lustre.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853345.832486:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787853345.832896:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491727104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853345.832953:0:25021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787853345.832962:0:25021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787853345.837444:0:25034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787853345.837463:0:25034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cfbe025b3a0) 00000020:00000080:0.0:1787853345.837490:0:25034:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787853345.837595:0:25034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac4504000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787853345.837604:0:25034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac4504000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787853345.837607:0:25034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac4504000 3 00010000:00080000:0.0:1787853345.837636:0:25034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfac3930000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1787853345.839238:0:25034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787853345.839428:0:25034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787853345.839468:0:25034:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787853345.839480:0:25034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe2bf4b958af30f2 00000100:00080000:0.0:1787853345.839491:0:25034:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787853345.839497:0:25034:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfac3930000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1787853345.839531:0:25034:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfac47f43c0 x1874699491727232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853345.839573:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491727232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787853345.839644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.839715:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727232 00000100:00100000:0.0:1787853345.839721:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727232 00000100:00100000:0.0:1787853345.839754:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853345.839760:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1874699491727232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787853345.839783:0:22699:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1787853345.839824:0:22699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe2bf4b958af30f9 00000004:00100000:0.0:1787853345.839839:0:22699:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787853345.839906:0:22699:0:(import.c:65:import_set_state_nolock()) ffff8cfac3931000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853345.839970:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874699491727232:12345-0@lo:38:llog_process_th.0 Request processed in 208us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.839978:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787853345.840017:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfac47f43c0 x1874699491727232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853345.840026:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853345.840040:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787853345.840047:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787853345.840051:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853345.840053:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfac3930000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853345.840059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1874699491727232:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787853345.840077:0:25034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1787853345.847199:0:25034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787853345.847217:0:25034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cfbe60819d0) 00000020:00000080:1.0:1787853345.847246:0:25034:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787853345.847503:0:25034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfac4504000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787853345.847507:0:25034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfac4504000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787853345.847510:0:25034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfac4504000 3 00010000:00080000:1.0:1787853345.847542:0:25034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfbe02d8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1787853345.850680:0:25034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787853345.855747:0:25034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787853345.855797:0:25034:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787853345.855810:0:25034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe2bf4b958af3107 00000100:00080000:1.0:1787853345.855821:0:25034:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853345.855827:0:25034:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cfbe02d8800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853345.855891:0:25034:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd92d00 x1874699491727360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853345.855929:0:25034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787853345.856057:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1874699491727360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853345.856128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853345.856246:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727360 00000100:00100000:1.0:1787853345.856262:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727360 00000100:00100000:1.0:1787853345.856299:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853345.856314:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd558f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1874699491727360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787853345.856339:0:22700:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:1.0:1787853345.856381:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe2bf4b958af310e 00000004:00100000:1.0:1787853345.856395:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787853345.856421:0:22700:0:(import.c:65:import_set_state_nolock()) ffff8cfac10eb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853345.856466:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd558f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874699491727360:12345-0@lo:38:llog_process_th.0 Request processed in 151us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853345.856473:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787853345.856537:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfbfbd92d00 x1874699491727360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853345.856548:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853345.856554:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787853345.856560:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787853345.856563:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787853345.856566:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbe02d8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787853345.856571:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1874699491727360:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787853345.871921:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787853345.871987:0:25021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787853345.872018:0:25021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853345.872035:0:25021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30e4 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853345.872047:0:25021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccbc00/0xe2bf4b958af30dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af30e4 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787853345.872102:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787853345.872104:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787853345.872106:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853345.872107:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853345.872108:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853345.872110:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853345.872111:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853345.872113:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853345.872115:0:25021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853345.872119:0:25021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787853345.872122:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853345.872124:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787853345.872130:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853345.872131:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853345.872132:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853345.872133:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853345.872134:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853345.872135:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853345.872136:0:25021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853345.872163:0:25021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787853345.872184:0:25021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491727488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853345.872258:0:25021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853345.872297:0:25021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc7548600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853345.872391:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727488 00000100:00100000:1.0:1787853345.872398:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727488 00000100:00100000:1.0:1787853345.872441:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787853345.872450:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:25021:x1874699491727488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787853345.872476:0:22692:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787853345.872489:0:22692:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787853345.881276:0:22692:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787853345.881296:0:22692:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787853345.881453:0:22714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787853345.881459:0:22714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787853345.881484:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881503:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 24 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881511:0:22714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881519:0:22714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881563:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 24 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881577:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 24 pid: 22691 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.881592:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491727616:0@lo:104: 00000100:00100000:0.0:1787853345.881661:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853345.881731:0:22714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 24 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.881753:0:22714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 24 pid: 22692 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.881761:0:22714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491727744:0@lo:104: 00000100:00100000:0.0:1787853345.881785:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.881813:0:22714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2e36240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853345.881885:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727616 00000100:00100000:2.0:1787853345.881892:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727616 00000100:00100000:2.0:1787853345.881938:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727744 00000100:00100000:2.0:1787853345.881941:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727744 00000100:00100000:2.0:1787853345.881956:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853345.881964:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491727616:12345-0@lo:104: 00010000:00010000:2.0:1787853345.881975:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882032:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853345.882037:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:22714:x1874699491727616:12345-0@lo:104: Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.882044:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853345.882062:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853345.882067:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491727744:12345-0@lo:104: 00010000:00010000:2.0:1787853345.882087:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882133:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853345.882137:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:22714:x1874699491727744:12345-0@lo:104: Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.882144:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787853345.882160:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853345.882166:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882173:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3800 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853345.882177:0:22687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882185:0:22687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853345.882191:0:22687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853345.882197:0:22687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853345.882226:0:22687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882233:0:22687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853345.882251:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882259:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbcaff3800/0xe2bf4b958af2fb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fb7 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882287:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853345.882290:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882296:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb200 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:2.0:1787853345.882299:0:22687:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882319:0:22687:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853345.882326:0:22687:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853345.882330:0:22687:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853345.882344:0:22687:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882350:0:22687:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853345.882355:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882361:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb200/0xe2bf4b958af2fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2fa9 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853345.882374:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.882376:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.882377:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853345.882384:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853345.882411:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491727872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853345.882440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853345.882458:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853345.882463:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491728000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853345.882482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853345.882879:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491727872 00000100:00100000:0.0:1787853345.882886:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491727872 00010000:00010000:0.0:1787853345.882909:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 25 pid: 22691 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.882947:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728000 00000100:00100000:0.0:1787853345.882950:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728000 00010000:00010000:0.0:1787853345.882962:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 26 pid: 22692 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.882974:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853345.882981:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+26:3645:x1874699491727872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853345.882992:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853345.882997:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 26 pid: 22691 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883006:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 26 pid: 22691 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883021:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853345.883057:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+26:3645:x1874699491727872:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.883063:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853345.883100:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853345.883105:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+25:3645:x1874699491728000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853345.883113:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853345.883117:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 25 pid: 22692 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883125:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 25 pid: 22692 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883136:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883144:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853345.883157:0:22684:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004719052s 00010000:00010000:0.0:1787853345.883161:0:22684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883167:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883173:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883179:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883185:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853345.883188:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883206:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883214:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883223:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853345.883247:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+25:3645:x1874699491728000:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853345.883253:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853345.883295:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491728000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853345.883416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491727872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853345.883452:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff2800/0xe2bf4b958af2fb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2fb0 expref: 24 pid: 22691 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.883463:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491727616:0@lo:104: 00010000:00010000:0.0:1787853345.883472:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbcaff2a00/0xe2bf4b958af2fa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2fa2 expref: 23 pid: 22692 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853345.883480:0:22714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22714:1874699491727744:0@lo:104: 00010000:00010000:0.0:1787853345.883494:0:22714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883502:0:22714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883508:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853345.883520:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd95000/0xe2bf4b958af3115 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853345.883909:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:25021:x1874699491727488:12345-0@lo:253:mount.lustre.0 Request processed in 11459us (11649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853345.883928:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787853345.884013:0:25021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:25021:1874699491727488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853345.884024:0:25021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787853345.884026:0:25021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853345.884028:0:25021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787853345.884029:0:25021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853345.884030:0:25021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853345.884031:0:25021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853345.884032:0:25021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853345.884034:0:25021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853345.884036:0:25021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853345.884037:0:25021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787853345.884050:0:25021:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1787853345.890741:0:25021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787853345.898820:0:25021:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787853345.898830:0:25021:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787853345.898897:0:25021:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787853345.898958:0:25021:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787853345.898975:0:25021:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787853345.898993:0:25021:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787853345.901322:0:25021:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787853345.901698:0:25021:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787853346.320599:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787853346.704290:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787853346.721198:0:25088:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787853346.721792:0:25088:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787853347.735929:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787853347.735949:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfac39d1000 from 14 10000000:01000000:2.0:1787853347.735955:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787853347.736002:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853347.736015:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853347.736026:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853347.736054:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853347.736147:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853347.736206:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfac2508180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853347.736417:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728128 00000100:00100000:3.0:1787853347.736425:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728128 00000100:00100000:3.0:1787853347.736483:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787853347.736494:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491728128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853347.736507:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853347.736522:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbc0030200/0xe2bf4b958af3123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af311c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.736545:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbc0030200/0xe2bf4b958af3123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af311c expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.736567:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbc0030200/0xe2bf4b958af3123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af311c expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.736577:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbc0030200, rc 0) 00000100:00100000:3.0:1787853347.736620:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491728128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853347.736626:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787853347.736975:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853347.736990:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3123 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.736998:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af3123 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853347.737047:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728256:0@lo:256:ll_cfg_requeue.0 00010000:00010000:2.0:1787853347.737183:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853347.737218:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853347.737265:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcbdd0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853347.747310:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728256 00000100:00100000:2.0:1787853347.747328:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728256 00000100:00100000:2.0:1787853347.747437:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787853347.747448:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491728256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787853347.747488:0:22692:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853347.747504:0:22692:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853347.747507:0:22692:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787853347.747670:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491728256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 224us (10451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853347.747678:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787853347.747787:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853347.747898:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853347.747910:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3123 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853347.747920:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4795800/0xe2bf4b958af311c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3123 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853347.747931:0:22695:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853347.747934:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfbfbd61000 from 14 10000000:01000000:0.0:1787853347.747936:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853347.747970:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853347.747977:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853347.747997:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853347.748020:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853347.748063:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853347.759729:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbff4fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853347.761226:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728384 00000100:00100000:3.0:1787853347.761241:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728384 00000100:00100000:3.0:1787853347.761340:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853347.761349:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491728384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853347.761373:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853347.761390:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbc0031000/0xe2bf4b958af3131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af312a expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.761415:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbc0031000/0xe2bf4b958af3131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af312a expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.761433:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbc0031000/0xe2bf4b958af3131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af312a expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.761442:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbc0031000, rc 0) 00000100:00100000:3.0:1787853347.761513:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491728384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (13451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853347.761519:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853347.761559:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853347.761576:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3131 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853347.761584:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af3131 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853347.763916:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787853347.764136:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853347.764188:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcbdd0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853347.764243:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728512 00000100:00100000:2.0:1787853347.764252:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728512 00000100:00100000:2.0:1787853347.764304:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787853347.764313:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491728512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787853347.764335:0:22692:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853347.764365:0:22692:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853347.764368:0:22692:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787853347.764816:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491728512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 502us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853347.764825:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787853347.764911:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491728512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853347.764976:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853347.764985:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3131 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853347.764996:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd94a00/0xe2bf4b958af312a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af3131 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853348.755234:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853349.520606:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491728640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787853349.520684:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853349.520770:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728640 00000100:00100000:1.0:1787853349.520787:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728640 00000100:00100000:1.0:1787853349.520887:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853349.520906:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491728640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787853349.520934:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787853349.522756:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491728640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1844us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853349.522767:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787853349.522804:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853349.523222:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491728640:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787853349.780704:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853350.544903:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491728768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853350.544980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853350.545108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491728896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853350.545138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853350.545186:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728768 00000100:00100000:3.0:1787853350.545194:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728768 00000100:00100000:3.0:1787853350.545235:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491728896 00000100:00100000:3.0:1787853350.545239:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491728896 00000100:00100000:3.0:1787853350.545257:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853350.545265:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491728768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787853350.545299:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787853350.545345:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491728768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853350.545353:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853350.545370:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853350.545376:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491728896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787853350.545393:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853350.545424:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491728896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853350.545430:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853350.545477:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491728768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853350.545509:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491728896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853350.546947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491729024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853350.547018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853350.550913:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729024 00000100:00100000:2.0:1787853350.550925:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729024 00000100:00100000:2.0:1787853350.551008:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853350.551019:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4752580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491729024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853350.551151:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853350.551234:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4752580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491729024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853350.551242:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853350.551308:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfc32d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491729024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787853350.551412:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853350.800041:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853351.056318:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491729152:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.056405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.056487:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729152 00000100:00100000:2.0:1787853351.056495:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729152 00000100:00100000:2.0:1787853351.056540:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787853351.056549:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd216a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3643:x1874699491729152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.056597:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd216a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3643:x1874699491729152:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.056604:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787853351.056652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491729152:0@lo:400:kworker.0 00000100:00080000:1.0:1787853351.059875:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853351.059883:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853351.059888:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853351.059895:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 683 00000100:00080000:1.0:1787853351.059900:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787853351.059907:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfbfdcb2800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853351.059930:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbfbd92d00 x1874699491729536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853351.059970:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853351.059974:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853351.059975:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853351.059979:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 683 00000100:00080000:1.0:1787853351.059981:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787853351.059984:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfbc3750800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1787853351.059995:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfbff4cf480 x1874699491730048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853351.060055:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491729280:0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.060120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491729920:0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.060200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491730560:0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.060248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060274:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787853351.060280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491729792:0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.060375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060394:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491730432:0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.060413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060439:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491729536:0@lo:8:kworker.0 00000100:00100000:1.0:1787853351.060463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060481:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491730048:0@lo:8:kworker.0 00000100:00100000:1.0:1787853351.060502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.060532:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729280 00000100:00100000:1.0:1787853351.060539:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729280 00000100:00100000:1.0:1787853351.060579:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729792 00000100:00100000:1.0:1787853351.060582:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729792 00000100:00100000:2.0:1787853351.060689:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874699491729664:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.060719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.060739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491730304:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.060758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.060776:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787853351.060782:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491729408:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.060804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.060834:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491730176:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.060877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.060888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491730688:0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.060911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.060932:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729920 00000100:00100000:2.0:1787853351.060936:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729920 00000100:00100000:2.0:1787853351.060973:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729536 00000100:00100000:2.0:1787853351.060976:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729536 00000100:00100000:2.0:1787853351.060985:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730048 00000100:00100000:2.0:1787853351.060995:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730048 00000100:00100000:2.0:1787853351.061006:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729408 00000100:00100000:2.0:1787853351.061009:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729408 00000100:00100000:2.0:1787853351.061025:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853351.061034:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491729920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.061086:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491729920:12345-0@lo:400:kworker.0 Request processed in 53us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.061093:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853351.061110:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853351.061117:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853351.061149:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491729408:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.061155:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853351.061167:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853351.061172:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1874699491729536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787853351.061198:0:24204:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1787853351.061238:0:24204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2bf4b958af3138 00002000:00100000:2.0:1787853351.061253:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cfbfe314000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787853351.061257:0:24204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787853351.061260:0:24204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787853351.061970:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787853351.061998:0:24204:0:(import.c:65:import_set_state_nolock()) ffff8cfbfe315800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853351.062048:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874699491729536:12345-0@lo:8:kworker.0 Request processed in 874us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.062055:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853351.062073:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853351.062078:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1874699491730048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787853351.062105:0:24204:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1787853351.062124:0:24204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe2bf4b958af313f 00002000:00100000:2.0:1787853351.062134:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cfbfe310000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787853351.062137:0:24204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787853351.062139:0:24204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787853351.062168:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787853351.062180:0:24204:0:(import.c:65:import_set_state_nolock()) ffff8cfbfe310800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853351.062208:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1874699491730048:12345-0@lo:8:kworker.0 Request processed in 129us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.062214:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853351.062254:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730560 00000100:00100000:2.0:1787853351.062260:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730560 00000100:00100000:2.0:1787853351.062286:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730432 00000100:00100000:1.0:1787853351.062409:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853351.062418:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491729280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.062456:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491729280:12345-0@lo:400:kworker.0 Request processed in 40us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853351.062462:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853351.062475:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787853351.062482:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853351.062510:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491729792:12345-0@lo:400:kworker.0 Request processed in 29us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853351.062516:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787853351.062544:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491729664 00000100:00100000:1.0:1787853351.062548:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491729664 00000100:00100000:1.0:1787853351.062564:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730304 00000100:00100000:1.0:1787853351.062567:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730304 00000100:00100000:1.0:1787853351.062582:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730176 00000100:00100000:1.0:1787853351.062584:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730176 00000100:00080000:3.0:1787853351.063436:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853351.063503:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730688 00000100:00100000:1.0:1787853351.063509:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730688 00000100:00100000:1.0:1787853351.063529:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853351.063567:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730432 00000100:00100000:2.0:1787853351.063602:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787853351.067569:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787853351.067578:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853351.067614:0:24959:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787853351.067629:0:24959:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787853351.067743:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853351.067759:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491730304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.067889:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491730304:12345-0@lo:400:kworker.0 Request processed in 137us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.067898:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853351.067922:0:24959:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787853351.067930:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853351.067937:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491730176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.067970:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874699491730176:12345-0@lo:400:kworker.0 Request processed in 33us (7092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.067976:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853351.067987:0:24959:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787853351.067994:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853351.068000:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd29ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874699491730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.068029:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd29ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874699491730688:12345-0@lo:400:kworker.0 Request processed in 29us (7116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.068034:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853351.068044:0:24959:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787853351.068049:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853351.068055:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.068084:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491730432:12345-0@lo:400:kworker.0 Request processed in 30us (7670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.068090:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853351.068268:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491729408:0@lo:400:kworker.0 00010000:00080000:3.0:1787853351.068284:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4ce940 x1874699491730176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068306:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874699491730176:0@lo:400:kworker.0 00010000:00080000:3.0:1787853351.068326:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4ced00 x1874699491730688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068336:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1874699491730688:0@lo:400:kworker.0 00010000:00080000:3.0:1787853351.068345:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cf840 x1874699491730304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068354:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491730304:0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.068397:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491729792:0@lo:400:kworker.0 00010000:00080000:3.0:1787853351.068408:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cde00 x1874699491730432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068417:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491730432:0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.068429:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491729280:0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.068440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491729920:0@lo:400:kworker.0 00010000:00080000:3.0:1787853351.068480:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfbd92d00 x1874699491729536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068489:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853351.068499:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787853351.068507:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787853351.068512:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787853351.068515:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbfdcb2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787853351.068538:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787853351.068543:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1874699491729536:0@lo:8:kworker.0 00010000:00080000:3.0:1787853351.068557:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cf480 x1874699491730048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.068571:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853351.068576:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787853351.068581:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787853351.068585:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787853351.068587:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8cfbc3750800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787853351.068598:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787853351.068602:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1874699491730048:0@lo:8:kworker.0 00000004:00080000:3.0:1787853351.068651:0:23443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787853351.068673:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491730944:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787853351.068713:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853351.068736:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcbdd0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853351.068746:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853351.068754:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491730816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853351.068778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787853351.068874:0:22725:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787853351.068889:0:22725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22725:1874699491731200:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787853351.068913:0:22725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853351.068927:0:22725:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcbdd0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787853351.068938:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853351.068958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853351.068992:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730816 00000100:00100000:3.0:1787853351.068998:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730816 00000100:00100000:3.0:1787853351.069031:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731072 00000100:00100000:3.0:1787853351.069034:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731072 00000100:00100000:3.0:1787853351.069050:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853351.069056:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1874699491730816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787853351.069096:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787853351.069136:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1874699491730816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.069143:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853351.069159:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787853351.069165:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874699491731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853351.069175:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787853351.069203:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874699491731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.069209:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787853351.069238:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787853351.069265:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac47521c0 x1874699491731072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.069280:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491731072:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787853351.069306:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac4750f00 x1874699491730816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.069316:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491730816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853351.069338:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491730944 00000100:00100000:3.0:1787853351.069341:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491730944 00000100:00100000:3.0:1787853351.069369:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731200 00000100:00100000:3.0:1787853351.069372:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731200 00000100:00100000:3.0:1787853351.069390:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853351.069397:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23443:x1874699491730944:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787853351.069581:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853351.069588:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22725:x1874699491731200:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787853351.081700:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491730560:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1787853351.081742:0:22724:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787853351.081836:0:22724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689144993604ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787853351.081858:0:22724:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787853351.081884:0:23442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787853351.081924:0:23442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 689145081114ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787853351.081929:0:23442:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787853351.083701:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874699491729664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853351.087908:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491730560:12345-0@lo:400:kworker.0 Request processed in 24363us (27649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853351.087924:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787853351.087978:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cda40 x1874699491730560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853351.087992:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491730560:0@lo:400:kworker.0 00000100:00100000:3.0:1787853351.090057:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874699491729664:12345-0@lo:400:kworker.0 Request processed in 26442us (29330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.090069:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787853351.090113:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfbd90780 x1874699491729664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853351.090125:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874699491729664:0@lo:400:kworker.0 00000004:00080000:0.0:1787853351.090696:0:22678:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787853351.091735:0:23431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787853351.099652:0:24689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787853351.099666:0:24689:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1787853351.099679:0:24689:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00080000:3.0:1787853351.104128:0:24204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787853351.104141:0:24204:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787853351.104248:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23443:x1874699491730944:12345-0@lo:7:osp-pre-1-1.0 Request processed in 34847us (35530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853351.104262:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787853351.104505:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac47512c0 x1874699491730944/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787853367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853351.104521:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491730944:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787853351.104535:0:23443:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787853351.104579:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491731328:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787853351.104625:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.104654:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc66143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853351.104675:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731328 00000100:00100000:1.0:1787853351.104681:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731328 00000100:00100000:1.0:1787853351.104724:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853351.104732:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23443:x1874699491731328:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787853351.104755:0:24206:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787853351.104799:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23443:x1874699491731328:12345-0@lo:5:osp-pre-1-1.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853351.104805:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787853351.104862:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cc3c0 x1874699491731328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853351.104872:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491731328:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787853351.104880:0:23443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787853351.104902:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491731456:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787853351.104921:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.104934:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc66143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853351.104943:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731456 00000100:00100000:1.0:1787853351.104945:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731456 00000100:00100000:1.0:1787853351.104965:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853351.104970:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23443:x1874699491731456:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787853351.104992:0:24206:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1787853351.115327:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.115341:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.115359:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.115363:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.115370:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.115386:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.115396:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.115404:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.115429:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853351.115839:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853351.115867:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.115877:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853351.115881:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.115891:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.115921:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.115929:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af3146 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.115946:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853351.115947:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853351.115949:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853351.119765:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787853351.119779:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.119795:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1787853351.119801:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853351.119808:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.119839:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.119878:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.119886:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.119906:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853351.120089:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853351.120096:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.120104:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.120109:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.120118:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.120134:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.120141:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af314d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.120155:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.120163:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.120164:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.127450:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.127462:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.127480:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.127484:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.127492:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.127520:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.127531:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.127539:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.127563:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853351.128706:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853351.128717:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.128729:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:1.0:1787853351.128733:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.128743:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.128761:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.128768:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af3154 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.128799:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853351.128801:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853351.128802:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853351.131028:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787853351.131039:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.131056:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:3.0:1787853351.131060:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853351.131066:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.131080:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.131091:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.131110:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.131136:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853351.132577:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.132600:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132615:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.132619:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.132625:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132636:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132646:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132668:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132685:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787853351.132868:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853351.132875:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132883:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0031800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.132887:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132896:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132915:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132922:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036f15e44/0xe2bf4b958af315b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132940:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.132944:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132961:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.132964:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132972:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132982:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.132989:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af3162 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133001:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.133003:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.133005:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.133272:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.133278:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133288:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.133291:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.133295:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133305:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133319:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133325:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.133342:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853351.134143:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.134151:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134160:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.134164:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.134168:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134188:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134196:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134203:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134235:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787853351.134566:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.134572:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134581:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.134595:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.134600:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134610:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134617:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134623:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.134631:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787853351.134995:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.135001:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135010:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.135018:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.135023:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135033:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135041:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135047:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135055:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787853351.135335:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.135340:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135348:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.135351:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.135355:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135364:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135372:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135386:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.135394:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787853351.135584:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787853351.135592:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135600:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.135604:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135612:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135628:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135635:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af3169 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135655:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787853351.135658:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135677:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.135680:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135688:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135704:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135712:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3170 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135726:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787853351.135730:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135736:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.135739:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135746:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135755:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135768:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3177 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135779:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853351.135782:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135788:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.135791:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135798:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135808:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135816:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af317e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135839:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853351.135859:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135865:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.135875:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135882:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135891:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135898:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3185 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.135915:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.135917:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.135919:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.136109:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.139462:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.139473:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.139492:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.139497:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.139504:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.139518:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.139528:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.139537:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.139709:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853351.140009:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.140016:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.140029:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.140033:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.140038:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.140048:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.140056:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.140064:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143170:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853351.143184:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143198:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95600 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.143202:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143213:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143293:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143303:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af318c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143327:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853351.143331:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143338:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95a00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.143341:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143366:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143376:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.143385:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.143387:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.143389:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.144864:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853351.144875:0:24689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af3193 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853351.145400:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.145407:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145420:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.145424:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.145430:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145457:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145467:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145476:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145490:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853351.145791:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.145797:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145806:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.145810:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.145814:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145835:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145882:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145901:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.145926:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787853351.146172:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.146178:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.146187:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.146191:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.146195:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.146205:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.146213:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.146311:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.146323:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787853351.147197:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853351.147206:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147210:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853351.147216:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147216:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1787853351.147220:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853351.147309:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147320:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147329:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147337:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147345:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787853351.147378:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.147383:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147393:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147410:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147417:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af319a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147444:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853351.147448:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147455:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.147458:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147466:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147476:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147483:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147496:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853351.147499:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147505:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.147509:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147528:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147539:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147546:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147559:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853351.147562:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147569:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.147638:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147646:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147656:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147662:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df6f38f4/0xe2bf4b958af31af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.147684:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.147686:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.147688:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.147696:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787853351.147951:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787853351.147957:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147976:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1787853351.147979:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853351.147984:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.147994:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.148002:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.148009:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853351.148102:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853351.148677:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853351.148683:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.148693:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240a00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.148697:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.148706:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.148719:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.148726:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be5bf43/0xe2bf4b958af31b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.148741:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.148742:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.148744:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853351.150382:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787853351.150393:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.150413:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=689s v=(0 0) 00010000:00010000:2.0:1787853351.150417:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853351.150423:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.150435:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.150445:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.150452:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.150513:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787853351.150746:0:25022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787853351.150771:0:25022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787853351.150781:0:25022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787853351.153295:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23443:x1874699491731456:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48313us (48362us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787853351.153308:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00010000:0.0:1787853351.153438:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.153447:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.153464:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.153469:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.153476:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.153490:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.153500:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.153508:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853351.158055:0:23443:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787853351.158073:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23443:1874699491731456:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787853351.158093:0:23443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787853351.158158:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23443:1874699491731584:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787853351.158255:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853351.158296:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc66143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853351.158503:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731584 00000100:00100000:2.0:1787853351.158510:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731584 00000100:00100000:2.0:1787853351.158561:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853351.158579:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23443:x1874699491731584:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787853351.158640:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23443:x1874699491731584:12345-0@lo:900:osp-pre-1-1.0 Request processed in 72us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853351.158648:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787853351.158899:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbff4cc3c0 x1874699491731584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787853367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853351.158911:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23443:1874699491731584:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1787853351.160279:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853351.160293:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160307:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.160312:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160324:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160347:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160366:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088d7814c/0xe2bf4b958af31bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160391:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853351.160396:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160403:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95a00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.160406:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160414:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160425:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.160434:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.160436:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.160438:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.163339:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.163339:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853351.163352:0:24689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706c008f/0xe2bf4b958af31c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853351.164506:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.164516:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164543:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.164548:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.164555:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164568:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164869:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164877:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164896:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.164906:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.164912:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164920:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.164924:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164933:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164961:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164969:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092adad5c/0xe2bf4b958af31cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.164984:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.164987:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.164988:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.166094:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.166103:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166115:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.166119:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.166124:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166134:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166144:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166156:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166187:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.166198:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.166202:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166210:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.166214:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166439:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166727:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166736:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036524e1d/0xe2bf4b958af31d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.166754:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.166756:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.166757:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.167135:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.167141:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167150:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.167160:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.167165:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167176:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167184:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167191:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167206:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.167215:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.167219:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167232:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.167236:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167244:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167254:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167273:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec51826/0xe2bf4b958af31d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.167288:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.167290:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.167291:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.168403:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.168412:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168424:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.168428:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.168433:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168444:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168453:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168461:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168477:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.168488:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.168500:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168508:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94600 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.168512:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168522:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168534:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168542:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2f72d72/0xe2bf4b958af31e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.168558:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.168560:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.168562:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.169756:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.169765:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169777:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.169781:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.169786:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169807:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169816:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169837:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169872:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.169882:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.169886:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169894:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.169898:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169906:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169918:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169926:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af31e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.169948:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.169950:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.169951:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.170317:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.170324:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170333:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.170336:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.170341:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170351:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170359:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170367:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170381:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.170389:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.170393:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170411:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.170414:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170421:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170432:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170439:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059481d7b/0xe2bf4b958af31ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.170453:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.170454:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.170456:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.171872:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.171882:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171896:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.171899:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.171904:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171915:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171932:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171939:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171956:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.171967:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.171972:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171980:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.171984:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.171993:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172006:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172014:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eb5bb3c/0xe2bf4b958af31f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172041:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.172048:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.172050:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.172434:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.172441:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172450:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.172454:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.172458:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172467:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172475:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172482:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172495:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.172504:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.172508:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172515:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95600 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.172519:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172538:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172550:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172557:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d301d5da/0xe2bf4b958af31fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.172729:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.172732:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.172734:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.173788:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.173797:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173809:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.173814:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.173830:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173857:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173867:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173880:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173895:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.173905:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.173909:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173916:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.173920:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173929:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173943:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173951:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44f0d67/0xe2bf4b958af3203 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.173967:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.173968:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.173970:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.174430:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.174443:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174452:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.174456:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.174460:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174470:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174478:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174486:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174501:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853351.174509:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853351.174513:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174520:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95e00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853351.174524:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174532:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174549:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.174557:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887f8e80/0xe2bf4b958af320a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.175659:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.175665:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.175668:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.176390:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.176399:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.176413:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.176417:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.176422:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.176433:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.176442:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.176448:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.176483:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853351.176671:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853351.176678:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.176686:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95200 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853351.176690:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.176698:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.176714:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.176723:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cef67ff/0xe2bf4b958af3211 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853351.176740:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.176741:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853351.176743:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853351.180469:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.180485:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.180504:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.180509:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.180515:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.180529:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.180540:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.180548:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.180968:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787853351.184296:0:24689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787853351.184311:0:24689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.184330:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1787853351.184348:0:24689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853351.184355:0:24689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.184370:0:24689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.184381:0:24689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853351.184389:0:24689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186119:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853351.186131:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186146:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95000 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.186161:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186173:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186194:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186202:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c19373f2/0xe2bf4b958af3218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186562:0:22687:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853351.186567:0:22687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186573:0:22687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:3.0:1787853351.186577:0:22687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186583:0:22687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186608:0:22687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853351.186616:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.186624:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853351.186626:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.186780:0:24689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853351.186787:0:24689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014333dca/0xe2bf4b958af321f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787853351.187109:0:24689:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787853351.187199:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22725:x1874699491731200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 117607us (118281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853351.187209:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853351.190398:0:22725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22725:1874699491731200:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787853351.190419:0:22725:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787853351.190485:0:22725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd29a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22725:1874699491731712:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787853351.190544:0:22725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853351.190581:0:22725:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbfb769e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853351.190676:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731712 00000100:00100000:0.0:1787853351.190683:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731712 00000100:00100000:0.0:1787853351.190741:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853351.190751:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22725:x1874699491731712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787853351.190791:0:24207:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1787853351.192475:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22725:x1874699491731712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1721us (1925us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787853351.192492:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853351.192549:0:22725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd29a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22725:1874699491731712:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787853351.192562:0:22725:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1787853351.193692:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853351.830319:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853352.403864:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787853352.582494:0:25379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787853352.850038:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787853353.611500:0:25431:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787853353.612235:0:25431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787853353.873135:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853354.641917:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd8ca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491731840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787853354.642003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853354.655181:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731840 00000100:00100000:2.0:1787853354.655195:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731840 00000100:00100000:2.0:1787853354.657823:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853354.657838:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491731840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787853354.657895:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853354.657981:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491731840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (15978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853354.657989:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853354.658045:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd8ca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491731840:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787853354.658115:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1787853354.787198:0:25482:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787853354.787473:0:25482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787853354.896743:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853355.139952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.140108:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747648 00000100:00100000:2.0:1787853355.140118:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747648 00000100:00100000:2.0:1787853355.140158:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1787853355.140166:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1874699472747648:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787853355.140195:0:22692:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 0d4d2481-625b-4f67-b5fb-f788d42d4220@192.168.201.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1787853355.140227:0:22692:0:(genops.c:1385:class_connect()) connect: client 0d4d2481-625b-4f67-b5fb-f788d42d4220, cookie 0xe2bf4b958af3226 00000100:00080000:2.0:1787853355.140359:0:22692:0:(import.c:65:import_set_state_nolock()) ffff8cfbfe312800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853355.140438:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc2d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+5:2395:x1874699472747648:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 270us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.140447:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:0.0:1787853355.149385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.149496:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747776 00000100:00100000:2.0:1787853355.149506:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747776 00000100:00100000:2.0:1787853355.149691:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:2.0:1787853355.149702:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+5:18058:x1874699472747776:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853355.149718:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853355.149746:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af322d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c841259ed expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.149791:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259ed expref: 6 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.149804:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794c00/0xe2bf4b958af322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259ed expref: 6 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.149814:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794c00, rc 0) 00000100:00100000:2.0:1787853355.149905:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+6:18058:x1874699472747776:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 204us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.149912:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1787853355.152023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853355.156624:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472747904 00000100:00100000:1.0:1787853355.156639:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472747904 00000100:00100000:0.0:1787853355.156807:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1787853355.156819:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+6:18058:x1874699472747904:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853355.156978:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+6:18058:x1874699472747904:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 162us (4965us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853355.156986:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1787853355.164687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.164784:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748032 00000100:00100000:0.0:1787853355.164797:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748032 00000100:00100000:0.0:1787853355.164887:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:0.0:1787853355.164898:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+6:18058:x1874699472748032:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853355.164917:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853355.164937:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfcd95600/0xe2bf4b958af3234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c841259f4 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853355.164968:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcd95600/0xe2bf4b958af3234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259f4 expref: 7 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853355.164998:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfcd95600/0xe2bf4b958af3234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c841259f4 expref: 7 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853355.165008:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd95600, rc 0) 00000100:00100000:0.0:1787853355.165090:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+7:18058:x1874699472748032:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 193us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.165097:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1787853355.178636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.182148:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748160 00000100:00100000:0.0:1787853355.182166:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748160 00000100:00100000:0.0:1787853355.182239:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:0.0:1787853355.182250:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+7:18058:x1874699472748160:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853355.182457:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18058:x1874699472748160:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 207us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.182465:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:1.0:1787853355.184536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.184793:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748288 00000100:00100000:2.0:1787853355.184804:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748288 00000100:00100000:2.0:1787853355.184884:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:2.0:1787853355.184894:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18058:x1874699472748288:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787853355.185022:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18058:x1874699472748288:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 129us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.185031:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:3.0:1787853355.188331:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.189011:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748416 00000100:00100000:2.0:1787853355.189021:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748416 00000100:00100000:2.0:1787853355.189075:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:2.0:1787853355.189085:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748416:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853355.189227:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748416:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 143us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.189236:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1787853355.226062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.226148:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748544 00000100:00100000:0.0:1787853355.226158:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748544 00000100:00100000:0.0:1787853355.226215:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:0.0:1787853355.226225:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748544:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853355.227994:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748544:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 1758us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.228009:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1787853355.239034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.239139:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748672 00000100:00100000:2.0:1787853355.239150:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748672 00000100:00100000:2.0:1787853355.239211:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:2.0:1787853355.239221:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748672:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853355.239400:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18076:x1874699472748672:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 179us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.239408:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:0.0:1787853355.244932:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.245124:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748800 00000100:00100000:2.0:1787853355.245134:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748800 00000100:00100000:2.0:1787853355.245191:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:2.0:1787853355.245200:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+8:18058:x1874699472748800:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853355.245217:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853355.245233:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4795600/0xe2bf4b958af323b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a25 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.245261:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4795600/0xe2bf4b958af323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a25 expref: 9 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.245272:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4795600/0xe2bf4b958af323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a25 expref: 9 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.245281:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4795600, rc 0) 00000100:00100000:2.0:1787853355.245338:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+9:18058:x1874699472748800:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 139us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.245345:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1787853355.253161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.253250:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472748928 00000100:00100000:3.0:1787853355.253260:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472748928 00000100:00100000:3.0:1787853355.253318:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:3.0:1787853355.253328:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+9:18058:x1874699472748928:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787853355.253354:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787853355.253376:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787853355.253380:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787853355.253383:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787853355.253386:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787853355.253388:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787853355.255453:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+9:18058:x1874699472748928:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 2118us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.255466:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:0.0:1787853355.261270:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.261375:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749056 00000100:00100000:2.0:1787853355.261385:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749056 00000100:00100000:2.0:1787853355.261456:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:2.0:1787853355.261466:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbde6ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+9:18058:x1874699472749056:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853355.261483:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853355.261498:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a2c expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.261536:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 10 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.261547:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 10 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853355.261556:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794000, rc 0) 00000100:00100000:2.0:1787853355.261625:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbde6ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18058:x1874699472749056:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 160us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.261632:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:1.0:1787853355.264223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.264344:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749184 00000100:00100000:3.0:1787853355.264353:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749184 00000100:00100000:3.0:1787853355.264404:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1787853355.264413:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18058:x1874699472749184:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787853355.265730:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18058:x1874699472749184:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 1310us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.265771:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:1.0:1787853355.271121:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.271214:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749312 00000100:00100000:0.0:1787853355.271237:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749312 00000100:00100000:0.0:1787853355.271338:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:0.0:1787853355.271348:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18058:x1874699472749312:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787853355.271486:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18058:x1874699472749312:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.271493:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:3.0:1787853355.278038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.278149:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749440 00000100:00100000:2.0:1787853355.278159:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749440 00000100:00100000:2.0:1787853355.278221:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:2.0:1787853355.278230:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18080:x1874699472749440:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853355.278397:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf57d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18080:x1874699472749440:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 167us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.278405:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:1.0:1787853355.300243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.302955:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749568 00000100:00100000:2.0:1787853355.302970:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749568 00000100:00100000:2.0:1787853355.303046:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:2.0:1787853355.303056:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18080:x1874699472749568:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853355.303222:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18080:x1874699472749568:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 167us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.303231:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:1.0:1787853355.321968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853355.322069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.323390:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749696 00000100:00100000:3.0:1787853355.323403:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749696 00000100:00100000:3.0:1787853355.323456:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749952 00000100:00100000:3.0:1787853355.323460:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749952 00000100:00100000:3.0:1787853355.323494:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1787853355.323502:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1874699472749696:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787853355.323534:0:24959:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from b68e2f5e-4262-4d07-bfe9-53094ce47db6@192.168.201.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1787853355.323599:0:24959:0:(genops.c:1385:class_connect()) connect: client b68e2f5e-4262-4d07-bfe9-53094ce47db6, cookie 0xe2bf4b958af3249 00000004:00100000:3.0:1787853355.323625:0:24959:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787853355.323685:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1787853355.323691:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1874699472749952:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787853355.323708:0:25311:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from b68e2f5e-4262-4d07-bfe9-53094ce47db6@192.168.201.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:0.0:1787853355.323739:0:25311:0:(genops.c:1385:class_connect()) connect: client b68e2f5e-4262-4d07-bfe9-53094ce47db6, cookie 0xe2bf4b958af3250 00000004:00100000:0.0:1787853355.323762:0:25311:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787853355.323951:0:25311:0:(import.c:65:import_set_state_nolock()) ffff8cfac3937000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787853355.324114:0:24959:0:(import.c:65:import_set_state_nolock()) ffff8cfbe70a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853355.324167:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2395:x1874699472749696:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 664us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.324175:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1787853355.331487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.331537:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.334768:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2395:x1874699472749952:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 11053us (12677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.334784:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1787853355.334834:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750208 00000100:00100000:0.0:1787853355.334860:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750208 00000100:00100000:2.0:1787853355.339762:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472749824 00000100:00100000:2.0:1787853355.339784:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472749824 00000100:00100000:2.0:1787853355.339903:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1787853355.339915:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18058:x1874699472750208:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787853355.339959:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787853355.340063:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18058:x1874699472750208:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 149us (8584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.340087:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1787853355.340106:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1787853355.340113:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:0:x1874699472749824:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787853355.340124:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787853355.340148:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:0:x1874699472749824:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 36us (8610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.340154:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:1.0:1787853355.340433:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853355.341998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.342091:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750080 00000100:00100000:3.0:1787853355.342100:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750080 00000100:00100000:3.0:1787853355.342163:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1787853355.342172:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:0:x1874699472750080:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787853355.342205:0:24959:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853355.342278:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:0:x1874699472750080:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.342285:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:1.0:1787853355.342745:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787853355.349897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.350034:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750336 00000100:00100000:3.0:1787853355.350044:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750336 00000100:00100000:3.0:1787853355.350111:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1787853355.350121:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750336:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787853355.350215:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750336:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.350222:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1787853355.353165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.353352:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750464 00000100:00100000:2.0:1787853355.353363:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750464 00000100:00100000:2.0:1787853355.353414:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1787853355.353422:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1874699472750464:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787853355.353459:0:24206:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from b68e2f5e-4262-4d07-bfe9-53094ce47db6@192.168.201.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1787853355.353510:0:24206:0:(genops.c:1385:class_connect()) connect: client b68e2f5e-4262-4d07-bfe9-53094ce47db6, cookie 0xe2bf4b958af3257 00002000:00100000:2.0:1787853355.353532:0:24206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b68e2f5e-4262-4d07-bfe9-53094ce47db6/ffff8cfbfe317800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787853355.353544:0:24206:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787853355.353735:0:24206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787853355.353781:0:24206:0:(import.c:65:import_set_state_nolock()) ffff8cfbfe316000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853355.354043:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2395:x1874699472750464:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 619us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.354060:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1787853355.357715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853355.357778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853355.357895:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750720 00000100:00100000:3.0:1787853355.357904:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750720 00000100:00100000:3.0:1787853355.357966:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1787853355.357976:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750720:12345-192.168.201.29@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787853355.358076:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750720:12345-192.168.201.29@tcp:900:mount.lustre.0 Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.358084:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1787853355.359171:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750592 00000100:00100000:1.0:1787853355.359180:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750592 00000100:00100000:1.0:1787853355.359265:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1787853355.359272:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1874699472750592:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853355.359305:0:24204:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from b68e2f5e-4262-4d07-bfe9-53094ce47db6@192.168.201.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1787853355.359333:0:24204:0:(genops.c:1385:class_connect()) connect: client b68e2f5e-4262-4d07-bfe9-53094ce47db6, cookie 0xe2bf4b958af325e 00002000:00100000:1.0:1787853355.359345:0:24204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b68e2f5e-4262-4d07-bfe9-53094ce47db6/ffff8cfac10ed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853355.359363:0:24204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787853355.359507:0:24204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787853355.359547:0:24204:0:(import.c:65:import_set_state_nolock()) ffff8cfac10e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853355.359624:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2395:x1874699472750592:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 351us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853355.359631:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1787853355.365543:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853355.365745:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750848 00000100:00100000:0.0:1787853355.365770:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750848 00000100:00100000:2.0:1787853355.366148:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1787853355.366160:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750848:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787853355.369616:0:22702:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3370us 00000004:00200000:3.0:1787853355.378961:0:22702:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787853355.379094:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18058:x1874699472750848:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 12931us (13555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853355.379121:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1787853355.584361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853355.584471:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472750976 00000100:00100000:1.0:1787853355.584483:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472750976 00000100:00100000:1.0:1787853355.584558:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1787853355.584568:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18103:x1874699472750976:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:1.0:1787853355.584597:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853355.584622:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241000/0xe2bf4b958af3265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a5d expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584686:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584700:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584715:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853355.584792:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787853355.584796:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853355.584881:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584908:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241000/0xe2bf4b958af3265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a5d expref: 8 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584927:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a5d expref: 7 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853355.584954:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:1.0:1787853355.584957:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853355.584961:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240000, rc 0) 00000100:00100000:1.0:1787853355.585027:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18103:x1874699472750976:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 460us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853355.585034:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1787853355.664422:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853355.664450:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491731968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853355.664527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853355.664603:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853355.664614:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491732096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853355.664653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853355.664834:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732096 00000100:00100000:0.0:1787853355.664859:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732096 00000100:00100000:0.0:1787853355.664913:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787853355.664936:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491732096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787853355.664965:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787853355.664982:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491732224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787853355.665032:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491732096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853355.665038:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853355.665175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853355.665258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491732096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853355.665315:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732224 00000100:00100000:1.0:1787853355.665320:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732224 00000100:00100000:1.0:1787853355.665351:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787853355.665358:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491732224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787853355.665372:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853355.665409:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491732224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853355.665415:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853355.665481:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491731968 00000100:00100000:2.0:1787853355.665485:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491731968 00000100:00100000:2.0:1787853355.665532:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853355.665539:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491731968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853355.665562:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853355.665597:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491731968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853355.665603:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853355.665637:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491731968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853355.665670:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491732224:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787853355.665811:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853355.920809:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853356.177659:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491732352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787853356.177732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.177781:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491732864:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.177806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.177824:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491733376:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.177862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.177879:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491733888:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.177898:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732864 00000100:00100000:2.0:1787853356.177905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853356.177905:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732864 00000100:00100000:2.0:1787853356.177926:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787853356.177933:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491732736:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.177952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853356.177953:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733376 00000100:00100000:0.0:1787853356.177955:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733376 00000100:00100000:2.0:1787853356.177965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491733248:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.177969:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732736 00000100:00100000:0.0:1787853356.177971:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732736 00000100:00100000:2.0:1787853356.177984:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853356.177984:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853356.177992:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.177993:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491733760:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.178013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853356.178037:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874699491732864:12345-0@lo:400:kworker.0 Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853356.178044:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853356.178055:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfbd91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491732864:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178058:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733248 00000100:00100000:0.0:1787853356.178060:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733248 00000100:00100000:0.0:1787853356.178076:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853356.178081:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491733376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178109:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491733376:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853356.178114:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853356.178126:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853356.178131:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178158:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491732736:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853356.178170:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853356.178181:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853356.178187:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491733248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.178207:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491732736:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178214:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491733248:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853356.178217:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491733248:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178220:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853356.178224:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491733376:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.178250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491732608:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.178278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.178318:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491733120:0@lo:400:kworker.0 00000100:00080000:1.0:1787853356.178446:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853356.178450:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853356.178460:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491732480:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.178508:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732608 00000100:00100000:0.0:1787853356.178512:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732608 00000100:00100000:3.0:1787853356.178530:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732352 00000100:00100000:3.0:1787853356.178534:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732352 00000100:00100000:0.0:1787853356.178538:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787853356.178543:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853356.178557:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853356.178563:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491732352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787853356.178582:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853356.180627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853356.180691:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491732992:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.180725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853356.180759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491733504:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.180780:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853356.180793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874699491734016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.180833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853356.180891:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733888 00000100:00100000:1.0:1787853356.180898:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733888 00000100:00100000:1.0:1787853356.180940:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733760 00000100:00100000:1.0:1787853356.180943:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733760 00000100:00100000:1.0:1787853356.180956:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732992 00000100:00100000:1.0:1787853356.180958:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732992 00000100:00100000:1.0:1787853356.180968:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733504 00000100:00100000:1.0:1787853356.180969:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733504 00000100:00100000:1.0:1787853356.180978:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734016 00000100:00100000:1.0:1787853356.180980:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734016 00000100:00100000:1.0:1787853356.180993:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853356.181000:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181306:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874699491733888:12345-0@lo:400:kworker.0 Request processed in 305us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.181314:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853356.181331:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853356.181518:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181569:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874699491733760:12345-0@lo:400:kworker.0 Request processed in 231us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.181587:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853356.181601:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853356.181608:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491732992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181647:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491732992:12345-0@lo:400:kworker.0 Request processed in 40us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.181653:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853356.181665:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853356.181671:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181707:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874699491733504:12345-0@lo:400:kworker.0 Request processed in 37us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.181713:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853356.181726:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853356.181732:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874699491734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181771:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874699491734016:12345-0@lo:400:kworker.0 Request processed in 39us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.181776:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787853356.181812:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853356.181816:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853356.181873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491732992:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181886:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874699491733504:0@lo:400:kworker.0 00010000:00080000:1.0:1787853356.181898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfcf4f480 x1874699491734016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853356.181909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1874699491734016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.181959:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491732480 00000100:00100000:1.0:1787853356.181964:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491732480 00000100:00100000:1.0:1787853356.181997:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787853356.182004:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491732480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.182646:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491732480:12345-0@lo:400:kworker.0 Request processed in 639us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.182656:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787853356.182702:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491732480:0@lo:400:kworker.0 00010000:00080000:1.0:1787853356.182790:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfcf4e940 x1874699491733760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853356.182813:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1874699491733760:0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.182829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1874699491733888:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.194957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.195017:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491733632:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.195092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.195120:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491734144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853356.195145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853356.195200:0:24208:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787853356.195209:0:24208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787853356.195303:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733632 00000100:00100000:2.0:1787853356.195310:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733632 00000100:00100000:2.0:1787853356.195571:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787853356.195582:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491733632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.195641:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874699491733632:12345-0@lo:400:kworker.0 Request processed in 61us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853356.195648:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787853356.195691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1874699491733632:0@lo:400:kworker.0 00000100:00100000:2.0:1787853356.195726:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734144 00000100:00100000:2.0:1787853356.195730:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734144 00000100:00100000:2.0:1787853356.195825:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853356.195834:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874699491734144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853356.195893:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787853356.195928:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874699491734144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853356.195934:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853356.195963:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491734144:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787853356.196106:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853356.196118:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491733120 00000100:00100000:1.0:1787853356.196122:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491733120 00000100:00100000:1.0:1787853356.196156:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853356.196162:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491733120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853356.196203:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491733120:12345-0@lo:400:kworker.0 Request processed in 41us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853356.196209:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853356.196234:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491733120:0@lo:400:kworker.0 00000100:00100000:0.0:1787853356.199187:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491732608:12345-0@lo:400:kworker.0 Request processed in 20633us (20897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853356.199202:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787853356.199463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491732608:0@lo:400:kworker.0 00000100:00100000:3.0:1787853356.203086:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491732352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 24504us (25334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853356.203101:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853356.203227:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491732352:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1787853356.560577:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787853356.692365:0:25022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b68e2f5e-4262-4d07-bfe9-53094ce47db6 00000001:00080000:0.0:1787853356.692382:0:25022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1787853356.945207:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853357.777916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853357.778738:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751104 00000100:00100000:0.0:1787853357.778753:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751104 00000100:00080000:1.0:1787853357.778951:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853357.779003:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1787853357.779016:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18155:x1874699472751104:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:0.0:1787853357.779056:0:22698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787853357.779177:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18155:x1874699472751104:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 164us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853357.779185:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1787853357.781572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853357.786023:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751232 00000100:00100000:1.0:1787853357.786049:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751232 00000100:00100000:1.0:1787853357.786194:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1787853357.786208:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18155:x1874699472751232:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:1.0:1787853357.786280:0:22699:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853357.786408:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18155:x1874699472751232:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 203us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853357.786428:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00080000:2.0:1787853357.788938:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853357.794024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853357.794168:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751360 00000100:00100000:2.0:1787853357.794182:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751360 00000100:00100000:2.0:1787853357.794290:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1787853357.794302:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18155:x1874699472751360:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1787853357.794353:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853357.794479:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18155:x1874699472751360:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 179us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853357.794489:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:1.0:1787853357.796140:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853357.815384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853357.816301:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751488 00000100:00100000:2.0:1787853357.816317:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751488 00000100:00100000:2.0:1787853357.816435:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1787853357.816447:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18155:x1874699472751488:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1787853357.816510:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1787853357.816699:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853357.817346:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18155:x1874699472751488:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 896us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853357.817358:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:0.0:1787853357.971806:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853358.070064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.070139:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751616 00000100:00100000:3.0:1787853358.070152:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751616 00000100:00100000:3.0:1787853358.070277:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:3.0:1787853358.070289:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+10:18184:x1874699472751616:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787853358.070319:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853358.070346:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbc0031200/0xe2bf4b958af3273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a64 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.070384:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbc0031200/0xe2bf4b958af3273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a64 expref: 11 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.070397:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbc0031200/0xe2bf4b958af3273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a64 expref: 11 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.070414:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbc0031200, rc 0) 00000100:00100000:3.0:1787853358.070500:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472751616:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 213us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.070529:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:1.0:1787853358.082032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.082643:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751744 00000100:00100000:0.0:1787853358.082678:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751744 00000100:00100000:0.0:1787853358.082774:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1787853358.082788:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472751744:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853358.083056:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472751744:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 270us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.083065:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1787853358.098569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.098777:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472751872 00000100:00100000:3.0:1787853358.098790:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472751872 00000100:00100000:3.0:1787853358.098889:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:3.0:1787853358.098901:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472751872:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787853358.099116:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472751872:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 215us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.099124:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:2.0:1787853358.113581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.114215:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752000 00000100:00100000:1.0:1787853358.114228:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752000 00000100:00100000:1.0:1787853358.114305:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:1.0:1787853358.114315:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752000:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853358.114553:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752000:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 239us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.114563:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:2.0:1787853358.167721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.167889:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752128 00000100:00100000:0.0:1787853358.167903:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752128 00000100:00100000:0.0:1787853358.167984:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:0.0:1787853358.167997:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752128:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853358.179247:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752128:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 11233us (11533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.179270:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:2.0:1787853358.195202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.195478:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752256 00000100:00100000:3.0:1787853358.195488:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752256 00000100:00100000:3.0:1787853358.195546:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:3.0:1787853358.195557:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752256:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853358.195717:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18193:x1874699472752256:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 161us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.195725:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:2.0:1787853358.204486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.204682:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752384 00000100:00100000:0.0:1787853358.204692:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752384 00000100:00100000:0.0:1787853358.204763:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:0.0:1787853358.204773:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18184:x1874699472752384:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853358.204791:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853358.204811:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfcd95a00/0xe2bf4b958af327a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a95 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.204838:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcd95a00/0xe2bf4b958af327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a95 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.204892:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfcd95a00/0xe2bf4b958af327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a95 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.205170:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd95a00, rc 0) 00000100:00100000:0.0:1787853358.205231:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18184:x1874699472752384:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 460us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.205239:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:2.0:1787853358.212089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.212386:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752512 00000100:00100000:1.0:1787853358.212397:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752512 00000100:00100000:1.0:1787853358.212452:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:1.0:1787853358.212462:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18184:x1874699472752512:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787853358.212501:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787853358.212524:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787853358.212528:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787853358.212531:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787853358.212534:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787853358.212536:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787853358.215393:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18184:x1874699472752512:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 2920us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.215409:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:2.0:1787853358.221646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.221782:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752640 00000100:00100000:0.0:1787853358.221791:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752640 00000100:00100000:0.0:1787853358.221873:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:0.0:1787853358.221883:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18184:x1874699472752640:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853358.221901:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853358.221917:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125a9c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.221944:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 13 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.221955:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 13 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853358.221965:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd95400, rc 0) 00000100:00100000:0.0:1787853358.222024:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18184:x1874699472752640:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 142us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.222031:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:2.0:1787853358.226020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.226100:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752768 00000100:00100000:1.0:1787853358.226110:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752768 00000100:00100000:1.0:1787853358.226161:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:1.0:1787853358.226170:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18184:x1874699472752768:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853358.226348:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbe7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18184:x1874699472752768:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 178us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.226356:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:2.0:1787853358.231988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.232230:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472752896 00000100:00100000:3.0:1787853358.232240:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472752896 00000100:00100000:3.0:1787853358.232297:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:3.0:1787853358.232315:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18184:x1874699472752896:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787853358.232483:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18184:x1874699472752896:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 169us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.232491:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:2.0:1787853358.240129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.240213:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753024 00000100:00100000:0.0:1787853358.240222:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753024 00000100:00100000:0.0:1787853358.240269:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:0.0:1787853358.240278:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18201:x1874699472753024:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853358.240443:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18201:x1874699472753024:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 165us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.240451:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:2.0:1787853358.260001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.260181:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753152 00000100:00100000:1.0:1787853358.260192:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753152 00000100:00100000:1.0:1787853358.260248:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:1.0:1787853358.260258:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18201:x1874699472753152:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853358.260601:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18201:x1874699472753152:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 343us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.260610:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:2.0:1787853358.284796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853358.284838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853358.284883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853358.284936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.285279:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753280 00000100:00100000:0.0:1787853358.285289:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753280 00000100:00100000:0.0:1787853358.285339:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753536 00000100:00100000:0.0:1787853358.285342:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753536 00000100:00100000:0.0:1787853358.285350:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753920 00000100:00100000:0.0:1787853358.285352:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753920 00000100:00100000:0.0:1787853358.285373:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754048 00000100:00100000:0.0:1787853358.285375:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754048 00000100:00100000:0.0:1787853358.285389:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1787853358.285398:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2397:x1874699472753920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1787853358.285483:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2397:x1874699472753920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 86us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.285491:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1787853358.285508:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1787853358.285514:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2397:x1874699472754048:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1787853358.285541:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2397:x1874699472754048:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.285548:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1787853358.285561:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1787853358.285566:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1874699472753280:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787853358.285589:0:22698:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 94714cf7-afeb-4188-9aff-dd0962db1ee7@192.168.201.29@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1787853358.285623:0:22698:0:(genops.c:1385:class_connect()) connect: client 94714cf7-afeb-4188-9aff-dd0962db1ee7, cookie 0xe2bf4b958af3288 00000004:00100000:0.0:1787853358.286145:0:22698:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787853358.286244:0:22698:0:(import.c:65:import_set_state_nolock()) ffff8cfac3935000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853358.286279:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2395:x1874699472753280:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 712us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.286287:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1787853358.286315:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1787853358.286319:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1874699472753536:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787853358.286336:0:22698:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0001: connection from 94714cf7-afeb-4188-9aff-dd0962db1ee7@192.168.201.29@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1787853358.286363:0:22698:0:(genops.c:1385:class_connect()) connect: client 94714cf7-afeb-4188-9aff-dd0962db1ee7, cookie 0xe2bf4b958af328f 00000004:00100000:0.0:1787853358.286375:0:22698:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787853358.286414:0:22698:0:(import.c:65:import_set_state_nolock()) ffff8cfac45f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853358.286439:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2395:x1874699472753536:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 117us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.286446:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1787853358.298072:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853358.298114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853358.298401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.298501:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753792 00000100:00100000:1.0:1787853358.298511:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753792 00000100:00100000:1.0:1787853358.298577:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753664 00000100:00100000:1.0:1787853358.298581:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753664 00000100:00100000:1.0:1787853358.298599:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472753408 00000100:00100000:1.0:1787853358.298601:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472753408 00000100:00100000:1.0:1787853358.298617:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1787853358.298628:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+7:18184:x1874699472753792:12345-192.168.201.29@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787853358.298871:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787853358.298875:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787853358.298966:0:25311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853358.299038:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+7:18184:x1874699472753792:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 413us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.299046:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1787853358.299065:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1787853358.299072:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:0:x1874699472753664:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787853358.299089:0:25311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853358.299156:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:0:x1874699472753664:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 83us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.299174:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1787853358.299186:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1787853358.299193:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:0:x1874699472753408:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787853358.299204:0:25311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853358.299226:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:0:x1874699472753408:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 33us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.299233:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:2.0:1787853358.306116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853358.306212:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754176 00000100:00100000:1.0:1787853358.306222:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754176 00000100:00100000:1.0:1787853358.306323:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1787853358.306334:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754176:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787853358.306428:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754176:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.306436:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1787853358.315411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.315452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.315555:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754304 00000100:00100000:3.0:1787853358.315563:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754304 00000100:00100000:3.0:1787853358.315602:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1787853358.315610:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1874699472754304:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787853358.315645:0:24689:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 94714cf7-afeb-4188-9aff-dd0962db1ee7@192.168.201.29@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1787853358.315675:0:24689:0:(genops.c:1385:class_connect()) connect: client 94714cf7-afeb-4188-9aff-dd0962db1ee7, cookie 0xe2bf4b958af3296 00002000:00100000:3.0:1787853358.315688:0:24689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 94714cf7-afeb-4188-9aff-dd0962db1ee7/ffff8cfbe70a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787853358.315710:0:24689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787853358.315929:0:24689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787853358.315961:0:24689:0:(import.c:65:import_set_state_nolock()) ffff8cfbe70a0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853358.316041:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2395:x1874699472754304:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 430us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.316224:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1787853358.316282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.316308:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754432 00000100:00100000:3.0:1787853358.316313:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754432 00000100:00100000:3.0:1787853358.316344:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1787853358.316350:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1874699472754432:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787853358.316369:0:24206:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 94714cf7-afeb-4188-9aff-dd0962db1ee7@192.168.201.29@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1787853358.316388:0:24206:0:(genops.c:1385:class_connect()) connect: client 94714cf7-afeb-4188-9aff-dd0962db1ee7, cookie 0xe2bf4b958af329d 00002000:00100000:3.0:1787853358.316395:0:24206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 94714cf7-afeb-4188-9aff-dd0962db1ee7/ffff8cfbe70a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787853358.316401:0:24206:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787853358.316451:0:24206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787853358.316832:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754560 00000100:00100000:0.0:1787853358.316837:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754560 00000100:00100000:0.0:1787853358.316900:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1787853358.316908:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754560:12345-192.168.201.29@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787853358.316961:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754560:12345-192.168.201.29@tcp:900:mount.lustre.0 Request processed in 54us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.316967:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00080000:0.0:1787853358.321277:0:24206:0:(import.c:65:import_set_state_nolock()) ffff8cfbe70a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853358.321478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853358.321506:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2395:x1874699472754432:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 5151us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853358.321520:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1787853358.321650:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754688 00000100:00100000:1.0:1787853358.321658:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754688 00000100:00100000:1.0:1787853358.321717:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1787853358.321727:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754688:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787853358.321807:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787853358.321903:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18184:x1874699472754688:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853358.321912:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1787853358.476401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853358.476503:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754816 00000100:00100000:3.0:1787853358.476526:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754816 00000100:00100000:3.0:1787853358.476597:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1787853358.476608:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18224:x1874699472754816:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:3.0:1787853358.476630:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853358.476652:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030600/0xe2bf4b958af32a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125acd expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476729:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476744:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476825:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853358.476897:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787853358.476901:0:24959:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787853358.476925:0:24959:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476952:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030600/0xe2bf4b958af32a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 8 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476970:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 7 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853358.476979:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:3.0:1787853358.476982:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853358.476986:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbc0030c00, rc 0) 00000100:00100000:3.0:1787853358.477065:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+7:18224:x1874699472754816:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 458us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853358.477073:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00010000:00010000:3.0:1787853358.991993:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853359.761143:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac3f7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491734272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787853359.761224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853359.761647:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734272 00000100:00100000:2.0:1787853359.761655:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734272 00000100:00100000:2.0:1787853359.761732:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853359.761741:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4c06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491734272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787853359.761772:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787853359.761821:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4c06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491734272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853359.761828:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787853359.761909:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853359.761944:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac3f7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491734272:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787853360.021401:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853360.784918:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491734400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853360.784993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853360.787010:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734400 00000100:00100000:3.0:1787853360.787024:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734400 00000100:00100000:3.0:1787853360.787102:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853360.787113:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491734400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853360.787139:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787853360.787223:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491734400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853360.787231:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853360.787286:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491734400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853360.789317:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853360.789397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1787853360.791786:0:23431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 94714cf7-afeb-4188-9aff-dd0962db1ee7 00000001:00100000:0.0:1787853360.791804:0:24201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 94714cf7-afeb-4188-9aff-dd0962db1ee7 00000001:00100000:2.0:1787853360.791805:0:23431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b68e2f5e-4262-4d07-bfe9-53094ce47db6 00000001:00100000:0.0:1787853360.791823:0:24201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b68e2f5e-4262-4d07-bfe9-53094ce47db6 00000100:00080000:1.0:1787853360.793278:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853360.793303:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491734656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853360.793403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853360.793446:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734528 00000100:00100000:3.0:1787853360.793456:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734528 00000100:00100000:1.0:1787853360.793518:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734656 00000100:00100000:3.0:1787853360.793523:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853360.793524:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734656 00000100:00100000:3.0:1787853360.793536:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491734528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853360.793552:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787853360.793560:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491734656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787853360.793573:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000004:00000024:1.0:1787853360.793580:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853360.793642:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491734528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853360.793646:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491734656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853360.793969:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787853360.794171:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787853360.794220:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491734656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853360.799208:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000001:00100000:0.0:1787853360.799910:0:22678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 94714cf7-afeb-4188-9aff-dd0962db1ee7 00000001:00100000:0.0:1787853360.799921:0:22678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b68e2f5e-4262-4d07-bfe9-53094ce47db6 00010000:00010000:3.0:1787853361.042499:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853361.296056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853361.296081:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491734784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787853361.296152:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853361.296152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853361.296163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491734912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853361.296192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853361.296235:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734784 00000100:00100000:1.0:1787853361.296243:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734784 00000100:00100000:0.0:1787853361.296277:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491734912 00000100:00100000:0.0:1787853361.296282:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491734912 00000100:00100000:0.0:1787853361.296306:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787853361.296338:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853361.296372:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491734784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787853361.296401:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787853361.296458:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874699491734784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853361.296523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1874699491734784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853361.297861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491735040:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.297921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.297959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491735552:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.297980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.298038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491736064:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.298169:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787853361.298175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491735168:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.298205:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491735680:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.298235:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491736192:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.298282:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735040 00000100:00100000:3.0:1787853361.298288:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735040 00000100:00100000:3.0:1787853361.298325:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787853361.298332:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298369:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491735040:12345-0@lo:400:kworker.0 Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.298376:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787853361.298578:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735552 00000100:00100000:3.0:1787853361.298581:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735552 00000100:00100000:3.0:1787853361.298600:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735168 00000100:00100000:3.0:1787853361.298603:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735168 00000100:00100000:3.0:1787853361.298614:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787853361.298619:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491735552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298662:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491735552:12345-0@lo:400:kworker.0 Request processed in 43us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.298679:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787853361.298692:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787853361.298697:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491735168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298727:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491735168:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.298732:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787853361.298748:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736064 00000100:00100000:3.0:1787853361.298751:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736064 00000100:00100000:3.0:1787853361.298778:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736192 00000100:00100000:3.0:1787853361.298780:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736192 00000100:00100000:3.0:1787853361.298798:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853361.298804:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298874:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491736064:12345-0@lo:400:kworker.0 Request processed in 70us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.298880:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853361.298892:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787853361.298897:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491736192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.298922:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874699491736192:12345-0@lo:400:kworker.0 Request processed in 26us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.298928:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787853361.298949:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735680 00000100:00100000:3.0:1787853361.298952:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735680 00000100:00100000:3.0:1787853361.298978:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853361.298984:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491735680:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787853361.299206:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853361.299210:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853361.299212:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787853361.300769:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491735680:12345-0@lo:400:kworker.0 Request processed in 1779us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853361.300797:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853361.300865:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491735296:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.300912:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.300939:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.300960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.300986:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491736320:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.301023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853361.301799:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735296 00000100:00100000:2.0:1787853361.301809:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735296 00000100:00100000:2.0:1787853361.301875:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853361.301884:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853361.301934:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491735296:12345-0@lo:400:kworker.0 Request processed in 52us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853361.301940:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853361.303261:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787853361.303286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491735424:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.303335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.303360:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.303866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853361.303914:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491735296:0@lo:400:kworker.0 00000100:00100000:3.0:1787853361.303955:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735808 00000100:00100000:3.0:1787853361.303961:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735808 00000100:00100000:1.0:1787853361.304196:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853361.304211:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491734912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853361.304235:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787853361.304284:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491734912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (8090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853361.304291:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853361.304322:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736320 00000100:00100000:1.0:1787853361.304337:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736320 00000100:00100000:1.0:1787853361.304362:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735424 00000100:00100000:1.0:1787853361.304364:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735424 00000100:00100000:1.0:1787853361.304482:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491735936 00000100:00100000:1.0:1787853361.304486:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491735936 00000100:00100000:1.0:1787853361.304506:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853361.304511:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304543:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491735808:12345-0@lo:400:kworker.0 Request processed in 31us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853361.304549:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853361.304559:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853361.304564:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491736320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304585:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491736320:12345-0@lo:400:kworker.0 Request processed in 22us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853361.304591:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853361.304600:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787853361.304604:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491735424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304623:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874699491735424:12345-0@lo:400:kworker.0 Request processed in 19us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853361.304628:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787853361.304636:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787853361.304641:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304674:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874699491735936:12345-0@lo:400:kworker.0 Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853361.304679:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787853361.304694:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853361.304698:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787853361.304726:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874699491735424:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1874699491735936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304744:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491735808:0@lo:400:kworker.0 00010000:00080000:1.0:1787853361.304755:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac4c04b40 x1874699491736320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853361.304766:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491736320:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304775:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787853361.304791:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491734912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853361.304889:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491735168:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304900:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491735680:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304909:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1874699491736192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304918:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491735040:0@lo:400:kworker.0 00000100:00100000:1.0:1787853361.304928:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491735552:0@lo:400:kworker.0 00010000:00080000:1.0:1787853361.304938:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbfcf4de00 x1874699491736064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853361.304948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491736064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853361.310176:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:02000400:3.0:1787853361.738519:0:25580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787853362.067371:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853362.641353:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853363.088116:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853363.714080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714140:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714201:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714282:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853363.714342:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755328 00000100:00100000:3.0:1787853363.714351:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755328 00000100:00100000:3.0:1787853363.714415:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755840 00000100:00100000:3.0:1787853363.714419:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755840 00000100:00100000:3.0:1787853363.714432:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755456 00000100:00100000:3.0:1787853363.714434:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755456 00000100:00100000:3.0:1787853363.714446:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755968 00000100:00100000:3.0:1787853363.714448:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755968 00000100:00100000:3.0:1787853363.714464:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1787853363.714472:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2399:x1874699472755328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.714717:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755072 00000100:00100000:1.0:1787853363.714723:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755072 00000100:00100000:1.0:1787853363.714759:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755584 00000100:00100000:1.0:1787853363.714762:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755584 00000100:00100000:1.0:1787853363.714774:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755200 00000100:00100000:1.0:1787853363.714777:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755200 00000100:00100000:1.0:1787853363.714801:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472755712 00000100:00100000:1.0:1787853363.714804:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472755712 00000100:00100000:1.0:1787853363.714820:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1787853363.714827:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2399:x1874699472755072:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.714918:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2399:x1874699472755072:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 91us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853363.714926:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1787853363.714944:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1787853363.714951:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2399:x1874699472755584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.714975:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2399:x1874699472755584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853363.714982:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1787853363.714993:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1787853363.714999:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472755200:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.715022:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472755200:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853363.715028:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1787853363.715040:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1787853363.715046:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472755712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.715070:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472755712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853363.715076:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1787853363.715098:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472754944 00000100:00100000:1.0:1787853363.715103:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472754944 00000100:00100000:1.0:1787853363.715140:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:1.0:1787853363.715146:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2398:x1874699472754944:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853363.715172:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2398:x1874699472754944:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853363.715178:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00080000:1.0:1787853363.715207:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853363.715211:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853363.715213:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853363.715215:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853363.718762:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2399:x1874699472755328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 4277us (4632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853363.718778:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1787853363.718814:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1787853363.718825:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2399:x1874699472755840:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853363.718873:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2399:x1874699472755840:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 53us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853363.718878:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1787853363.718888:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1787853363.718894:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472755456:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853363.718910:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4e8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472755456:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 17us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853363.718915:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1787853363.718926:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1787853363.718932:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2398:x1874699472755968:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853363.718967:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2398:x1874699472755968:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (4652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853363.718972:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000001:00100000:3.0:1787853363.859948:0:25022:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 94714cf7-afeb-4188-9aff-dd0962db1ee7 00010000:00010000:1.0:1787853364.113242:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853364.881528:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853364.881553:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491736448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787853364.881636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853364.881886:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736448 00000100:00100000:0.0:1787853364.881895:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736448 00000100:00100000:0.0:1787853364.881961:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853364.881971:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfbd91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491736448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787853364.882004:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787853364.882064:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfbd91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491736448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853364.882071:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787853364.882551:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853364.882606:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491736448:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787853365.138572:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853365.904084:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853365.904107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491736576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853365.904173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853365.904226:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736576 00000100:00100000:1.0:1787853365.904231:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736576 00000100:00100000:1.0:1787853365.904271:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853365.904279:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491736576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787853365.904308:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787853365.904344:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491736576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853365.904351:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853365.904393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491736576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853365.907317:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853365.907337:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787853365.907402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853365.907443:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736704 00000100:00100000:1.0:1787853365.907449:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736704 00000100:00100000:1.0:1787853365.907511:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853365.907519:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491736704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787853365.907553:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787853365.907615:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491736704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853365.907622:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853365.907665:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787853365.911284:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853365.911310:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853365.911378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.911427:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491736832 00000100:00100000:0.0:1787853365.911435:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491736832 00000100:00100000:0.0:1787853365.911503:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787853365.911512:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491736832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853365.911536:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787853365.911591:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874699491736832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.911598:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787853365.911620:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853365.911659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1874699491736832:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1787853365.912628:0:25728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9b048680 20000000:00000080:2.0:1787853365.912643:0:25728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfbf02de000 uarg=0000000000000000 20000000:01000000:2.0:1787853365.912681:0:25728:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787853365.912688:0:25728:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787853365.912693:0:25728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787853365.913582:0:25729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787853365.913716:0:25728:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787853365.935293:0:25728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787853365.935342:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936537:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 23 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936546:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 23 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936553:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936559:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936577:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936587:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936595:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936646:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936663:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 12 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.936679:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491736960:192.168.201.29@tcp:104: 00010000:00010000:2.0:1787853365.936807:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936823:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.936832:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4458780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737088:192.168.201.29@tcp:104: 00010000:00010000:2.0:1787853365.936899:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.936909:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.936921:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737216:0@lo:104: 00000100:00100000:2.0:1787853365.936969:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853365.937019:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.937029:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 23 pid: 22693 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.937038:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737344:0@lo:104: 00000100:00100000:2.0:1787853365.937057:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853365.937080:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 23 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.937086:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737216 00010000:00010000:2.0:1787853365.937088:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 23 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.937095:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737216 00000100:00100000:2.0:1787853365.937099:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737472:0@lo:104: 00000100:00100000:2.0:1787853365.937128:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.937139:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737344 00000100:00100000:0.0:1787853365.937144:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737344 00010000:00010000:2.0:1787853365.937158:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 23 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.937160:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737472 00000100:00100000:0.0:1787853365.937165:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737472 00010000:00010000:2.0:1787853365.937172:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 23 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.937181:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737600:0@lo:104: 00000100:00100000:0.0:1787853365.937185:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853365.937196:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:25728:x1874699491737216:12345-0@lo:104: 00010000:00010000:0.0:1787853365.937209:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.937213:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853365.937225:0:25728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc740a180 going to sleep for 11 seconds 00010000:00010000:0.0:1787853365.937290:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853365.937298:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:25728:x1874699491737216:12345-0@lo:104: Request processed in 103us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.937305:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853365.937325:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737600 00000100:00100000:0.0:1787853365.937328:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737600 00000100:00100000:0.0:1787853365.937340:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853365.937345:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:25728:x1874699491737344:12345-0@lo:104: 00010000:00010000:0.0:1787853365.937352:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937409:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787853365.937414:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+5:25728:x1874699491737344:12345-0@lo:104: Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.937421:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853365.937433:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853365.937438:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:25728:x1874699491737472:12345-0@lo:104: 00010000:00010000:0.0:1787853365.937445:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937470:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787853365.937475:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+4:25728:x1874699491737472:12345-0@lo:104: Request processed in 37us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.937480:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853365.937491:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853365.937496:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4459a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:25728:x1874699491737600:12345-0@lo:104: 00010000:00010000:0.0:1787853365.937503:0:22681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937528:0:22681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787853365.937533:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4459a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+3:25728:x1874699491737600:12345-0@lo:104: Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.937538:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787853365.937554:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787853365.937560:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937577:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853365.937588:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937596:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853365.937603:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853365.937608:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853365.937638:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937645:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853365.937667:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937673:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfbfcccb400/0xe2bf4b958af30cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af30d6 expref: -99 pid: 25021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937685:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787853365.937689:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937694:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4795400 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853365.937697:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937703:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853365.937719:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853365.937724:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853365.937737:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937743:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853365.937757:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937764:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4795400/0xe2bf4b958af2f55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f5c expref: -99 pid: 24200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937774:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853365.937777:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937783:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794e00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853365.937785:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937791:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853365.937797:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853365.937803:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853365.937822:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937828:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853365.937833:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937871:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4794e00/0xe2bf4b958af2f16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f1d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937882:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853365.937886:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937891:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4795e00 already unused, calling callback (ffffffffc1337c20) 10000000:00010000:0.0:1787853365.937894:0:22686:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937900:0:22686:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853365.937906:0:22686:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853365.937911:0:22686:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853365.937924:0:22686:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937929:0:22686:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853365.937934:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937949:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff8cfac4795e00/0xe2bf4b958af2f08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2bf4b958af2f0f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.937962:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853365.937964:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853365.937965:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853365.937986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491737728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.938043:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853365.938048:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491738112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.938088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491737856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.938128:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853365.938133:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491737984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853365.938177:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737728 00000100:00100000:0.0:1787853365.938181:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737728 00010000:00010000:0.0:1787853365.938200:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 24 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.938215:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738112 00000100:00100000:0.0:1787853365.938217:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738112 00010000:00010000:0.0:1787853365.938226:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 25 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.938235:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737856 00000100:00100000:0.0:1787853365.938242:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737856 00010000:00010000:0.0:1787853365.938256:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 26 pid: 22693 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.938267:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491737984 00000100:00100000:0.0:1787853365.938269:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491737984 00010000:00010000:0.0:1787853365.938278:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 27 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.938289:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853365.938295:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+27:3644:x1874699491737728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.938305:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.938309:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 27 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938318:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 27 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938334:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853365.938364:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+27:3644:x1874699491737728:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.938370:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853365.938384:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853365.938389:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+26:3644:x1874699491738112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.938396:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.938400:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 26 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938407:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 26 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938427:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853365.938449:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+26:3644:x1874699491738112:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.938455:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853365.938467:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853365.938473:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+25:3645:x1874699491737856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.938481:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.938485:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 25 pid: 22693 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938493:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 25 pid: 22693 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938502:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853365.938526:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+25:3645:x1874699491737856:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.938532:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853365.938544:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853365.938550:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491737984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.938557:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.938561:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 24 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938581:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 24 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.938591:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853365.938620:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3645:x1874699491737984:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.938627:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853365.938665:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491737984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938673:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491737856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938701:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491738112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853365.938709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3644:1874699491737728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853365.939191:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853365.943301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853365.943345:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756096 00000100:00100000:0.0:1787853365.943354:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756096 00010000:00010000:0.0:1787853365.943411:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 13 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.943446:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1787853365.943458:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac27d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2399:x1874699472756096:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.943473:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.943480:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 13 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.943498:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 13 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.943521:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853365.943583:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac27d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2399:x1874699472756096:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 127us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.943591:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00010000:00010000:2.0:1787853365.944871:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfcd95400/0xe2bf4b958af3281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a9c expref: 12 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.944889:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47512c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491736960:192.168.201.29@tcp:104: 00010000:00010000:2.0:1787853365.944905:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794a00/0xe2bf4b958af30d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af30cf expref: 23 pid: 22691 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.944913:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737216:0@lo:104: 00010000:00010000:2.0:1787853365.944923:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfbfc240600/0xe2bf4b958af2f5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2f55 expref: 22 pid: 22693 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.944930:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737344:0@lo:104: 00010000:00010000:2.0:1787853365.944938:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794400/0xe2bf4b958af2f1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2f16 expref: 21 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.944945:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737472:0@lo:104: 00010000:00010000:2.0:1787853365.944955:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794600/0xe2bf4b958af2f0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2bf4b958af2f08 expref: 20 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853365.944962:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737600:0@lo:104: 00000100:00100000:0.0:1787853365.947834:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4458780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874699491737088:192.168.201.29@tcp:104: 00010000:00010000:0.0:1787853365.947898:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853365.953117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853365.953246:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756224 00000100:00100000:0.0:1787853365.953256:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756224 00010000:00010000:0.0:1787853365.953294:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.953338:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1787853365.953348:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:2398:x1874699472756224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853365.953362:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853365.953378:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953392:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953411:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794000/0xe2bf4b958af3242 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a2c expref: 12 pid: 22692 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953427:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953436:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953451:0:22684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953473:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953479:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953485:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953492:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853365.953496:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953504:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953526:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853365.953537:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853365.953552:0:25728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.953575:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853365.953583:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfac4794800/0xe2bf4b958af32b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853365.953602:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:2398:x1874699472756224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 255us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853365.953611:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:0.0:1787853366.161618:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853366.416200:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853366.416227:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491738240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853366.416301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853366.416500:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738240 00000100:00100000:0.0:1787853366.416509:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738240 00000100:00100000:0.0:1787853366.416583:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853366.416594:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491738240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853366.416622:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787853366.416680:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491738240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853366.416688:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853366.416734:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491738240:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787853366.416831:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853366.419397:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac44592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491738368:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853366.419547:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738368 00000100:00100000:2.0:1787853366.419562:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738368 00000100:00100000:3.0:1787853366.419572:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4459680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491738880:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419601:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853366.419614:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787853366.419621:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4458780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491739392:0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.419623:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:3645:x1874699491738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853366.419662:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787853366.419666:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491738496:0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.419669:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:3645:x1874699491738368:12345-0@lo:400:kworker.0 Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853366.419676:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787853366.419685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853366.419701:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4458b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491739008:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853366.419741:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491739520:0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.419747:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739008 00000100:00100000:2.0:1787853366.419750:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739008 00000100:00100000:3.0:1787853366.419761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853366.419786:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853366.419790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac44592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3645:1874699491738368:0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.419792:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491739008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419820:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738880 00000100:00100000:3.0:1787853366.419823:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738880 00000100:00100000:2.0:1787853366.419825:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491739008:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853366.419831:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853366.419867:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738496 00000100:00100000:3.0:1787853366.419887:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738496 00000100:00100000:2.0:1787853366.419889:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853366.419895:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491738880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.419903:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853366.419908:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491738496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.419927:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491738880:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853366.419933:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787853366.419934:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491738496:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853366.420172:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853366.420202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491738496:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.420211:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4458b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491739008:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.420219:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4459680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491738880:0@lo:400:kworker.0 00000100:00100000:0.0:1787853366.420306:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4459e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491738624:0@lo:400:kworker.0 00000100:00100000:0.0:1787853366.420337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853366.420494:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739392 00000100:00100000:1.0:1787853366.420498:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739392 00000100:00100000:1.0:1787853366.420527:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739520 00000100:00100000:1.0:1787853366.420530:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739520 00000100:00100000:1.0:1787853366.420552:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787853366.420570:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491739392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.420626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491739904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787853366.420697:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738624 00000100:00100000:2.0:1787853366.420700:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738624 00000100:00100000:2.0:1787853366.420726:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853366.420732:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426057:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491739392:12345-0@lo:400:kworker.0 Request processed in 5477us (6401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.426074:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787853366.426114:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787853366.426127:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491739520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426179:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491739520:12345-0@lo:400:kworker.0 Request processed in 58us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.426185:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787853366.426231:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4458f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853366.426313:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491739264:0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853366.426464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491739776:0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853366.426517:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491738752 00000100:00100000:1.0:1787853366.426525:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491738752 00000100:00100000:1.0:1787853366.426567:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739264 00000100:00100000:1.0:1787853366.426570:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739264 00000100:00100000:1.0:1787853366.426585:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739776 00000100:00100000:1.0:1787853366.426587:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739776 00000100:00100000:1.0:1787853366.426604:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787853366.426610:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426644:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874699491738752:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.426650:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787853366.426662:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853366.426667:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491739264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426689:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874699491739264:12345-0@lo:400:kworker.0 Request processed in 22us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.426695:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853366.426705:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787853366.426711:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426735:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874699491739776:12345-0@lo:400:kworker.0 Request processed in 24us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.426741:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787853366.426771:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787853366.426776:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853366.426780:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853366.426813:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4458f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874699491738752:0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.426823:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874699491739264:0@lo:400:kworker.0 00010000:00080000:1.0:1787853366.426834:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac445b480 x1874699491739776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853366.426967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787853366.427006:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfac445b0c0 x1874699491739520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853366.427017:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491739520:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.427028:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4458780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491739392:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.427091:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739904 00000100:00100000:3.0:1787853366.427096:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739904 00000100:00100000:3.0:1787853366.427131:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853366.427138:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491739904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787853366.427154:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787853366.427192:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491739904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853366.427198:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853366.427233:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491739904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787853366.427683:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1874699491739776:0@lo:400:kworker.0 00000100:00080000:1.0:1787853366.427705:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853366.427782:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac44583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491739136:0@lo:400:kworker.0 00000100:00100000:0.0:1787853366.427819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853366.427865:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874699491739648:0@lo:400:kworker.0 00000100:00100000:0.0:1787853366.427890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853366.427962:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739648 00000100:00100000:1.0:1787853366.427966:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739648 00000100:00100000:1.0:1787853366.428006:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853366.428012:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874699491739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853366.428046:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874699491739648:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853366.428053:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787853366.428104:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853366.428122:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874699491739648:0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.431535:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491739136 00000100:00100000:3.0:1787853366.431553:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491739136 00000100:00100000:3.0:1787853366.431652:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787853366.431662:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491739136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853366.431790:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491739136:12345-0@lo:400:kworker.0 Request processed in 129us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853366.431798:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853366.432488:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac44583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491739136:0@lo:400:kworker.0 00000100:00100000:2.0:1787853366.436101:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491738624:12345-0@lo:400:kworker.0 Request processed in 15359us (15753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853366.436118:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853366.436328:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4459e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491738624:0@lo:400:kworker.0 00000040:00080000:1.0:1787853366.802628:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787853367.185331:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853367.567974:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853367.567983:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac4504000 from 13 10000000:01000000:0.0:1787853367.567989:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853367.568053:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853367.568064:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853367.568075:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853367.568103:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.568180:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853367.568236:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe026c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.568378:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740032 00000100:00100000:1.0:1787853367.568385:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740032 00000100:00100000:1.0:1787853367.568440:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787853367.568449:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+20:22695:x1874699491740032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853367.568462:0:22692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853367.568481:0:22692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc241600/0xe2bf4b958af32c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af32b9 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.568503:0:22692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc241600/0xe2bf4b958af32c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af32b9 expref: 21 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.568513:0:22692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc241600/0xe2bf4b958af32c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af32b9 expref: 21 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.568522:0:22692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241600, rc 0) 00000100:00100000:1.0:1787853367.568581:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.568595:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787853367.568703:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853367.568718:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32c0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853367.568727:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af32c0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853367.568788:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.568815:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853367.568835:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe026c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.569004:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740160 00000100:00100000:1.0:1787853367.569009:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740160 00000100:00100000:1.0:1787853367.569045:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787853367.569052:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.569166:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.569173:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787853367.570831:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.570942:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.571019:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853367.571068:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe026c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.571214:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740288 00000100:00100000:1.0:1787853367.571220:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740288 00000100:00100000:1.0:1787853367.571275:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787853367.571284:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.571398:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.571406:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787853367.571552:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac47f4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787853367.572529:0:25741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787853367.572881:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787853367.572907:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853367.572919:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32c0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.572931:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbfcd95c00/0xe2bf4b958af32b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32c0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853367.572942:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853367.572945:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac443e000 from 13 10000000:01000000:2.0:1787853367.572948:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853367.572985:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.572994:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.573006:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853367.573032:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853367.573090:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853367.573137:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf870a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.573255:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740416 00000100:00100000:1.0:1787853367.573268:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740416 00000100:00100000:1.0:1787853367.573314:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787853367.573322:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+21:22695:x1874699491740416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853367.573336:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853367.573348:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc241400/0xe2bf4b958af32ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af32c7 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.573369:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc241400/0xe2bf4b958af32ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af32c7 expref: 22 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.573379:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc241400/0xe2bf4b958af32ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af32c7 expref: 22 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.573388:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241400, rc 0) 00000100:00100000:1.0:1787853367.573433:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.573439:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787853367.573544:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853367.573563:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ce expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.573572:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af32ce expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853367.573631:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.573661:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853367.573694:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.573802:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740544 00000100:00100000:1.0:1787853367.573806:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740544 00000100:00100000:1.0:1787853367.573882:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787853367.573890:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.573990:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.573996:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787853367.579979:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.580081:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.580165:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853367.580224:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853367.580897:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740672 00000100:00100000:0.0:1787853367.580906:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740672 00000100:00100000:0.0:1787853367.580956:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787853367.580966:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.581111:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853367.581119:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787853367.583716:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787853367.587974:0:25742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787853367.588232:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787853367.588259:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853367.588271:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ce expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.588297:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4794800/0xe2bf4b958af32c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ce expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853367.588308:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787853367.588310:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfac39d1000 from 13 10000000:01000000:3.0:1787853367.588313:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853367.588350:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.588357:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.588367:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853367.588393:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.588463:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853367.588503:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.588587:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740800 00000100:00100000:1.0:1787853367.588595:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740800 00000100:00100000:1.0:1787853367.588648:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787853367.588657:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+22:22695:x1874699491740800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853367.588689:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853367.588703:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc241000/0xe2bf4b958af32dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af32d5 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.588729:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc241000/0xe2bf4b958af32dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af32d5 expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.588740:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc241000/0xe2bf4b958af32dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af32d5 expref: 23 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.588748:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241000, rc 0) 00000100:00100000:1.0:1787853367.588800:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491740800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.588806:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787853367.588960:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853367.588974:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32dc expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.588981:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af32dc expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853367.589038:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.589064:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853367.589104:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.589351:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491740928 00000100:00100000:1.0:1787853367.589356:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491740928 00000100:00100000:1.0:1787853367.589390:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787853367.589398:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491740928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.589512:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491740928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.589519:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787853367.589563:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbfcf4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.589595:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.589638:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853367.589654:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc67becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.589676:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491741056 00000100:00100000:1.0:1787853367.589679:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491741056 00000100:00100000:1.0:1787853367.589703:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787853367.589708:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491741056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.589782:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491741056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.589790:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787853367.589836:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeea1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853367.598025:0:25743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787853367.598341:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787853367.598365:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853367.598376:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32dc expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.598388:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfbc0030600/0xe2bf4b958af32d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32dc expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853367.598400:0:22695:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853367.598403:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfbfbd61000 from 13 10000000:01000000:2.0:1787853367.598406:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853367.598444:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.598453:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.598464:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853367.598490:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853367.598569:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853367.598616:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcaecbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853367.601333:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491741184 00000100:00100000:1.0:1787853367.601349:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491741184 00000100:00100000:1.0:1787853367.601411:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787853367.601420:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+23:22695:x1874699491741184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853367.601436:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853367.601452:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc241c00/0xe2bf4b958af32ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2bf4b958af32e3 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.601480:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc241c00/0xe2bf4b958af32ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2bf4b958af32e3 expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.601492:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc241c00/0xe2bf4b958af32ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2bf4b958af32e3 expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.601501:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241c00, rc 0) 00000100:00100000:1.0:1787853367.601597:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbc8775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491741184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.601605:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787853367.601704:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853367.601723:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ea expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.601732:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2bf4b958af32ea expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853367.601817:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853367.601881:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853367.601919:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcaecbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853367.602033:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491741312 00000100:00100000:0.0:1787853367.602048:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491741312 00000100:00100000:0.0:1787853367.602075:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787853367.602087:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491741312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.602203:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491741312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853367.602211:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787853367.602325:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853367.602353:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853367.602392:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853367.602421:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbcaecbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853367.602499:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491741440 00000100:00100000:3.0:1787853367.602504:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491741440 00000100:00100000:3.0:1787853367.602523:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787853367.602529:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491741440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.602724:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:22695:x1874699491741440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853367.602731:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787853367.602938:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:22695:1874699491741440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787853367.603902:0:25744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787853367.604187:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787853367.604208:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853367.604218:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ea expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853367.604229:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff8cfac4794600/0xe2bf4b958af32e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2bf4b958af32ea expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853367.614329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853367.614458:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756352 00000100:00100000:3.0:1787853367.614469:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756352 00000100:00100000:3.0:1787853367.614552:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 161 00000100:00100000:3.0:1787853367.614564:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+11:18073:x1874699472756352:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853367.614582:0:22691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853367.614603:0:22691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbc0031600/0xe2bf4b958af32f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125ad4 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.614636:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbc0031600/0xe2bf4b958af32f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ad4 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.614649:0:22691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbc0031600/0xe2bf4b958af32f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ad4 expref: 12 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853367.614659:0:22691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbc0031600, rc 0) 00000100:00100000:3.0:1787853367.614729:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756352:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 168us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853367.614737:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 161 00000100:00100000:3.0:1787853367.619722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853367.621486:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756480 00000100:00100000:1.0:1787853367.621513:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756480 00000100:00100000:1.0:1787853367.621587:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:1.0:1787853367.621598:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756480:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853367.621782:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756480:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 185us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.621790:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:2.0:1787853367.625252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853367.625343:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756608 00000100:00100000:0.0:1787853367.625354:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756608 00000100:00100000:0.0:1787853367.625409:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:0.0:1787853367.625419:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756608:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.625574:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756608:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853367.625583:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:2.0:1787853367.654321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853367.654436:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756736 00000100:00100000:1.0:1787853367.654448:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756736 00000100:00100000:1.0:1787853367.654514:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:1.0:1787853367.654526:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+12:18073:x1874699472756736:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853367.654558:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853367.654578:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfbfc240e00/0xe2bf4b958af32f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x53922e6c84125adb expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.654606:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfbfc240e00/0xe2bf4b958af32f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125adb expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.654619:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfbfc240e00/0xe2bf4b958af32f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125adb expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853367.654629:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240e00, rc 0) 00000100:00100000:1.0:1787853367.654701:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18073:x1874699472756736:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 176us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853367.654708:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:3.0:1787853367.660867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853367.664011:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756864 00000100:00100000:0.0:1787853367.664027:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756864 00000100:00100000:0.0:1787853367.664088:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:0.0:1787853367.664098:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18073:x1874699472756864:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853367.664267:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18073:x1874699472756864:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 169us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853367.664275:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:2.0:1787853367.675628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853367.676504:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472756992 00000100:00100000:3.0:1787853367.676517:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472756992 00000100:00100000:3.0:1787853367.676608:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:3.0:1787853367.676619:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18073:x1874699472756992:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853367.677029:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:18073:x1874699472756992:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 410us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853367.677037:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:2.0:1787853368.122918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.123062:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757120 00000100:00100000:1.0:1787853368.123073:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757120 00000100:00100000:1.0:1787853368.123152:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1787853368.123163:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:18694:x1874699472757120:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853368.123199:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.123220:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af32ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125ae2 expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123287:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123300:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123314:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123329:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123336:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123343:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123419:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240a00/0xe2bf4b958af3314 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123427:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240a00/0xe2bf4b958af3314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123433:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240a00/0xe2bf4b958af3314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.123461:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787853368.123470:0:24959:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853368.123511:0:24959:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240a00/0xe2bf4b958af3314 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123522:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123560:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123567:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123576:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.123581:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123589:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123604:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00000100:00080000:0.0:1787853368.123604:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853368.123610:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.123616:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123622:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123647:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123653:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123668:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123673:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240600 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.123675:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123681:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123688:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cfbe01b9200) 00010000:00010000:1.0:1787853368.123691:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.123693:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123699:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af330d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123729:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af32ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ae2 expref: 8 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123745:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240a00/0xe2bf4b958af3314 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ae2 expref: 7 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.123760:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfbe01b9300) 00010000:00010000:1.0:1787853368.123762:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853368.123764:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240a00, rc 0) 00000100:00100000:1.0:1787853368.123885:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18694:x1874699472757120:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 680us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.123905:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1787853368.127226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853368.127333:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757248 00000100:00100000:2.0:1787853368.127343:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757248 00000100:00100000:2.0:1787853368.127404:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1787853368.127414:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18694:x1874699472757248:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787853368.127515:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18694:x1874699472757248:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853368.127523:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1787853368.130250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.130387:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757504 00000100:00100000:3.0:1787853368.130396:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757504 00000100:00100000:3.0:1787853368.130456:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1787853368.130466:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:18694:x1874699472757504:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853368.130486:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.130504:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af331b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125ae9 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130592:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130609:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130620:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130650:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130658:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130684:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130795:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb200/0xe2bf4b958af3330 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130804:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb200/0xe2bf4b958af3330 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.130811:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb200/0xe2bf4b958af3330 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853368.130833:0:25311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787853368.131007:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131015:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131022:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131028:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0031800 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.131033:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131041:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131054:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfbe01b9300) 00010000:00010000:3.0:1787853368.131058:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.131069:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131076:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af3322 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131091:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131097:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131103:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131107:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.131110:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131117:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131125:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfbfb627500) 00010000:00010000:3.0:1787853368.131128:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.131131:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.131136:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3329 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.140991:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af331b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ae9 expref: 10 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.141041:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb200/0xe2bf4b958af3330 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125ae9 expref: 9 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.141051:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfbfb627000) 00010000:00010000:3.0:1787853368.141055:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.141059:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcccb200, rc 0) 00000100:00100000:3.0:1787853368.141135:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18694:x1874699472757504:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 10668us (10891us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787853368.141145:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1787853368.144460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.144586:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757632 00000100:00100000:1.0:1787853368.144597:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757632 00000100:00100000:1.0:1787853368.144674:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1787853368.144685:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18694:x1874699472757632:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787853368.144784:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18694:x1874699472757632:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.144791:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1787853368.152511:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853368.152693:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757760 00000100:00100000:2.0:1787853368.152702:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757760 00000100:00100000:2.0:1787853368.152780:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1787853368.152791:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18694:x1874699472757760:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787853368.153146:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787853368.167370:0:22700:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 14530us 00000100:00100000:0.0:1787853368.207323:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18694:x1874699472757760:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 54524us (54812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853368.207338:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00010000:00010000:0.0:1787853368.212179:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853368.212323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.212551:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472757888 00000100:00100000:3.0:1787853368.212562:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472757888 00000100:00100000:3.0:1787853368.212626:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1787853368.212637:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4459e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18700:x1874699472757888:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1787853368.212662:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.212684:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af333e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125af0 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212747:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212762:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212772:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212876:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212885:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212892:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212935:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212942:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212949:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212956:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0030e00 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.212960:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212967:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212978:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:3.0:1787853368.212981:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.212985:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.212991:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af3345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213011:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213016:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213022:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213027:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0031800 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.213030:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213036:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213043:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:3.0:1787853368.213046:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.213048:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213054:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af334c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213083:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af333e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125af0 expref: 10 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213093:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:3.0:1787853368.213096:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.213105:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af333e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125af0 expref: 10 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.213115:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcccb400, rc 0) 00000100:00100000:3.0:1787853368.213179:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4459e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18700:x1874699472757888:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 544us (862us total) trans 0 rc 301/301 00000100:00100000:3.0:1787853368.213186:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1787853368.229423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.229513:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758016 00000100:00100000:0.0:1787853368.229550:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758016 00000100:00100000:0.0:1787853368.229604:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1787853368.229614:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18700:x1874699472758016:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:0.0:1787853368.243757:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18700:x1874699472758016:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 14126us (14326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853368.243775:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1787853368.251941:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.252003:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758272 00000100:00100000:1.0:1787853368.252014:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758272 00000100:00100000:1.0:1787853368.252076:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1787853368.252087:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:18700:x1874699472758272:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1787853368.252152:0:24959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853368.252181:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af326c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125a5d expref: 9 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.252200:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:1.0:1787853368.252207:0:24959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853368.252263:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.252278:0:24959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 5 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.252308:0:24959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.252343:0:24959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 5 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.252357:0:24959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 5 pid: 24959 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853368.252371:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeeb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741568:192.168.201.29@tcp:104: 00000100:00100000:1.0:1787853368.252449:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc66146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853368.261958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.263107:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758400 00000100:00100000:0.0:1787853368.263121:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758400 00010000:00010000:0.0:1787853368.263187:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 6 pid: 24959 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853368.263214:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeeb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741568:192.168.201.29@tcp:104: 00000100:00100000:0.0:1787853368.263225:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1787853368.263233:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2398:x1874699472758400:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853368.263239:0:24959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263247:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853368.263254:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 6 pid: 24959 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263265:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 6 pid: 24959 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263289:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af32ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125acd expref: 6 pid: 24959 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263306:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:0.0:1787853368.263311:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263332:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263339:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.263369:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853368.263421:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472758400:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 188us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853368.263429:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00080000:1.0:1787853368.263480:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853368.264876:0:24959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.264891:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.264923:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.264936:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.264946:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270863:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270902:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270916:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853368.270937:0:24959:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c76e9a7 reply state 00000000408b8c54 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270949:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270957:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:3.0:1787853368.270960:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787853368.270963:0:24959:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787853368.270969:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787853368.270977:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270984:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270991:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.270996:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.271001:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.271009:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.271030:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbe01b9f00) 00010000:00010000:3.0:1787853368.271033:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.271037:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.271043:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3353 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853368.271079:0:24959:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c76e9a7 reply state 00000000408b8c54 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.271087:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.271093:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:3.0:1787853368.271095:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787853368.271097:0:24959:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787853368.271451:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+10:18700:x1874699472758272:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 19361us (19516us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787853368.271461:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1787853368.412649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.413040:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758528 00000100:00100000:0.0:1787853368.413051:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758528 00000100:00100000:0.0:1787853368.413122:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1787853368.413133:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+10:18708:x1874699472758528:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1787853368.413160:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853368.413188:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125af7 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413266:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94600/0xe2bf4b958af336f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413283:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94600/0xe2bf4b958af336f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413296:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94600/0xe2bf4b958af336f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853368.413349:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787853368.413353:0:22700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787853368.413409:0:22700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94600/0xe2bf4b958af336f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413430:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125af7 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413444:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94600/0xe2bf4b958af336f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125af7 expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853368.413450:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:0.0:1787853368.413454:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853368.413458:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd94600, rc 0) 00000100:00100000:0.0:1787853368.413551:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+11:18708:x1874699472758528:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 419us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853368.413559:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1787853368.461201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.461433:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758656 00000100:00100000:1.0:1787853368.461444:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758656 00000100:00100000:1.0:1787853368.461502:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1787853368.461511:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:18709:x1874699472758656:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1787853368.461540:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.461558:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125afe expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461635:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241e00/0xe2bf4b958af337d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461649:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241e00/0xe2bf4b958af337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461677:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241e00/0xe2bf4b958af337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.461730:0:22699:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787853368.461733:0:22699:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853368.461752:0:22699:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241e00/0xe2bf4b958af337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461774:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125afe expref: 7 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461792:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241e00/0xe2bf4b958af337d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125afe expref: 6 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.461801:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:1.0:1787853368.461804:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853368.461807:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc241e00, rc 0) 00000100:00100000:1.0:1787853368.461916:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18709:x1874699472758656:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 406us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.461923:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1787853368.469091:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.469233:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758784 00000100:00100000:1.0:1787853368.469244:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758784 00000100:00100000:1.0:1787853368.469306:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1787853368.469317:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:18709:x1874699472758784:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1787853368.469339:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.469358:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af3384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b05 expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469440:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469454:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469465:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469477:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469484:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469491:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469576:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469584:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.469591:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.469634:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787853368.469637:0:24959:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853368.469655:0:24959:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.470988:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.470997:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471005:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471011:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.471017:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471024:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471042:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:1.0:1787853368.471045:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.471051:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471057:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af338b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471070:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471077:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471083:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471097:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.471101:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471107:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471116:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:1.0:1787853368.471118:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.471121:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471127:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af3392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471162:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af3384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b05 expref: 8 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471176:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b05 expref: 7 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.471183:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:1.0:1787853368.471186:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853368.471188:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240600, rc 0) 00000100:00100000:1.0:1787853368.471263:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+7:18709:x1874699472758784:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1947us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.471272:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1787853368.476344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.476480:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472758912 00000100:00100000:0.0:1787853368.476490:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472758912 00000100:00080000:1.0:1787853368.476558:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787853368.476662:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1787853368.476676:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:18709:x1874699472758912:12345-192.168.201.29@tcp:900:lfs.0 00000100:00100000:2.0:1787853368.476775:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:18709:x1874699472758912:12345-192.168.201.29@tcp:900:lfs.0 Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853368.476782:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1787853368.491134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.491233:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472759168 00000100:00100000:1.0:1787853368.491245:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472759168 00000100:00100000:1.0:1787853368.491312:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1787853368.491322:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+7:18709:x1874699472759168:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1787853368.491345:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.491366:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b0c expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.491880:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787853368.491987:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b0c expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.492003:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:1.0:1787853368.492006:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853368.492011:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b0c expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.492025:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240400, rc 0) 00000100:00100000:1.0:1787853368.492081:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+8:18709:x1874699472759168:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 760us (956us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787853368.492088:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1787853368.496516:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.496680:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472759424 00000100:00100000:1.0:1787853368.496691:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472759424 00000100:00100000:1.0:1787853368.496764:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1787853368.496775:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+8:18709:x1874699472759424:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1787853368.496879:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853368.496910:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3399 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b05 expref: 8 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.496947:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:1.0:1787853368.496952:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853368.496976:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.496991:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.497004:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853368.497250:0:22698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cfd2153 reply state 000000005abe5132 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.497265:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.497271:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:1.0:1787853368.497274:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787853368.497276:0:22698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787853368.497283:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787853368.497362:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+9:18709:x1874699472759424:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 588us (856us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787853368.497368:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1787853368.504684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.504777:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472759680 00000100:00100000:1.0:1787853368.504787:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472759680 00000100:00100000:1.0:1787853368.504887:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1787853368.504898:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+9:18709:x1874699472759680:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1787853368.505123:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+10:18709:x1874699472759680:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 226us (451us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787853368.505144:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1787853368.510038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.510208:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472759936 00000100:00100000:1.0:1787853368.510221:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472759936 00000100:00100000:1.0:1787853368.510296:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:1.0:1787853368.510306:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+10:18709:x1874699472759936:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1787853368.510334:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.510354:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af33b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b13 expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510433:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510449:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510461:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510473:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510480:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510487:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.510606:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787853368.510691:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510731:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510738:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510743:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.510748:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510755:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510767:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:1.0:1787853368.510770:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.510774:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510781:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510797:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510802:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510808:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510813:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.510822:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510828:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510837:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:1.0:1787853368.510839:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.510910:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510916:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af33c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510951:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af33b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b13 expref: 12 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510960:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:1.0:1787853368.510962:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853368.510964:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af33b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b13 expref: 12 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.510972:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240600, rc 0) 00000100:00100000:1.0:1787853368.511028:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+11:18709:x1874699472759936:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 723us (1000us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1787853368.511036:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:0.0:1787853368.515422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.515595:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760064 00000100:00100000:1.0:1787853368.515605:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760064 00000100:00100000:1.0:1787853368.515669:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1787853368.515678:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+11:18709:x1874699472760064:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1787853368.515725:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.515745:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af33d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b1a expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.515887:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.515904:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.515915:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.515939:0:22699:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787853368.515943:0:22699:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853368.515962:0:22699:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.515989:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af33d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.516006:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.516014:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:1.0:1787853368.516016:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853368.516020:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240400, rc 0) 00000100:00100000:1.0:1787853368.516095:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:18709:x1874699472760064:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 418us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.516103:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1787853368.522013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.522191:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760192 00000100:00100000:1.0:1787853368.522202:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760192 00000100:00100000:1.0:1787853368.522267:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1787853368.522277:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:18709:x1874699472760192:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:1.0:1787853368.529508:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:18709:x1874699472760192:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 7219us (7493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.529532:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1787853368.537253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.537383:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760448 00000100:00100000:0.0:1787853368.537394:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760448 00000100:00100000:0.0:1787853368.537462:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1787853368.537472:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfce4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:18709:x1874699472760448:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1787853368.537739:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfce4e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+13:18709:x1874699472760448:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 267us (495us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787853368.537747:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1787853368.594978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.595073:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760576 00000100:00100000:3.0:1787853368.595082:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760576 00000100:00100000:3.0:1787853368.595181:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1787853368.595192:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+11:18715:x1874699472760576:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1787853368.595218:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.595250:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af33df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b21 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595321:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595336:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595628:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595658:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595667:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595674:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595758:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2800/0xe2bf4b958af33f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595768:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2800/0xe2bf4b958af33f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595774:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2800/0xe2bf4b958af33f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853368.595809:0:25311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787853368.595813:0:25311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787853368.595908:0:25311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2800/0xe2bf4b958af33f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595925:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595932:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595939:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595945:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0030e00 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.595948:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595957:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595968:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:3.0:1787853368.595971:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.595975:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595980:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030e00/0xe2bf4b958af33e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595993:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.595999:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596005:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596015:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfe3c3400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853368.596018:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596025:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596033:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:3.0:1787853368.596035:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853368.596038:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596044:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af33ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596185:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0030c00/0xe2bf4b958af33df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b21 expref: 13 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596198:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2800/0xe2bf4b958af33f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b21 expref: 12 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.596206:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:3.0:1787853368.596208:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853368.596210:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfe3c2800, rc 0) 00000100:00100000:3.0:1787853368.596266:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+12:18715:x1874699472760576:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1077us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.596274:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1787853368.599889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.599988:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760704 00000100:00100000:1.0:1787853368.599999:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760704 00000100:00100000:1.0:1787853368.600073:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1787853368.600086:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18715:x1874699472760704:12345-192.168.201.29@tcp:900:bash.0 00000100:00100000:1.0:1787853368.600264:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4458f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:18715:x1874699472760704:12345-192.168.201.29@tcp:900:bash.0 Request processed in 179us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.600272:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1787853368.603665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.603911:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472760960 00000100:00100000:1.0:1787853368.603922:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472760960 00000100:00100000:1.0:1787853368.603984:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1787853368.603994:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+12:18715:x1874699472760960:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1787853368.604019:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853368.604040:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af33fb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b28 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.604163:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.604179:0:22700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.604220:0:22700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.604262:0:22700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.604277:0:22700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 12 pid: 22699 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853368.604301:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22700:1874699491741696:192.168.201.29@tcp:104: 00000100:00100000:1.0:1787853368.604396:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6614e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853368.617118:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22700:1874699491741696:192.168.201.29@tcp:104: 00010000:00010000:1.0:1787853368.617156:0:22700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853368.618898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.619072:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472761088 00000100:00100000:3.0:1787853368.619099:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472761088 00010000:00010000:3.0:1787853368.619141:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 13 pid: 22699 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853368.619182:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1787853368.619194:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd8ca6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+13:2398:x1874699472761088:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853368.619212:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853368.619219:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 13 pid: 22699 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619233:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 13 pid: 22699 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619257:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af33d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b1a expref: 13 pid: 22699 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619274:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:3.0:1787853368.619279:0:22684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619296:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619304:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.619337:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853368.619403:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd8ca6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:2398:x1874699472761088:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 211us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.619418:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00010000:00010000:1.0:1787853368.620043:0:22700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620065:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620130:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620141:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620149:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620630:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620640:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620647:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853368.620657:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853368.620682:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620689:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620696:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620701:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240600 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.620719:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620727:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620738:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:1.0:1787853368.620741:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853368.620745:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620761:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3402 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853368.620775:0:22700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428d4862 reply state 00000000ea3c6f40 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620787:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620793:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8cfbe01b9200) 00010000:00010000:1.0:1787853368.620796:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787853368.620799:0:22700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787853368.620924:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af33fb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 15 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620940:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 14 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.620957:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853368.620960:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787853368.620963:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240800, rc 0) 00000100:00100000:1.0:1787853368.621029:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+15:18715:x1874699472760960:12345-192.168.201.29@tcp:101:bash.0 Request processed in 17036us (17375us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787853368.621038:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1787853368.638154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.638403:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472761216 00000100:00100000:3.0:1787853368.638413:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472761216 00000100:00100000:3.0:1787853368.638476:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1787853368.638486:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfcf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+15:18715:x1874699472761216:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1787853368.638513:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.638563:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af341e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b2f expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.638665:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.638680:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.638691:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853368.638898:0:22698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787853368.638902:0:22698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787853368.638922:0:22698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.638933:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.639024:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af341e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 17 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.639119:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.639139:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:3.0:1787853368.639142:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853368.639146:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfe3c2400, rc 0) 00000100:00100000:3.0:1787853368.639265:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfcf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:18715:x1874699472761216:12345-192.168.201.29@tcp:101:bash.0 Request processed in 780us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.639273:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1787853368.643175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853368.643275:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472761472 00000100:00100000:0.0:1787853368.643353:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472761472 00000100:00100000:0.0:1787853368.643460:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1787853368.643471:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:18715:x1874699472761472:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1787853368.644132:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4458780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+17:18715:x1874699472761472:12345-192.168.201.29@tcp:35:bash.0 Request processed in 660us (967us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787853368.644141:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1787853368.766239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.766413:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472761728 00000100:00100000:3.0:1787853368.766426:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472761728 00000100:00100000:3.0:1787853368.766549:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1787853368.766562:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+17:18725:x1874699472761728:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1787853368.766598:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.766620:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af342c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b36 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853368.766748:0:25311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787853368.766901:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af342c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b36 expref: 19 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.766915:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfbf1536e00) 00010000:00010000:3.0:1787853368.766918:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853368.766923:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af342c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b36 expref: 19 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.766947:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfe3c3a00, rc 0) 00000100:00100000:3.0:1787853368.767017:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+18:18725:x1874699472761728:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 458us (791us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787853368.767038:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1787853368.771722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.771828:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472761984 00000100:00100000:1.0:1787853368.771894:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472761984 00000100:00100000:1.0:1787853368.771961:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1787853368.771973:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+18:18725:x1874699472761984:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1787853368.772266:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18725:x1874699472761984:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 295us (556us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787853368.772275:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000040:00080000:2.0:1787853368.786437:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787853368.834960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.835475:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762112 00000100:00100000:1.0:1787853368.835485:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762112 00000100:00100000:1.0:1787853368.835555:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:1.0:1787853368.835811:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2399:x1874699472762112:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853368.835932:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2399:x1874699472762112:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 363us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.835941:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:2.0:1787853368.837089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.838065:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762240 00000100:00100000:1.0:1787853368.838075:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762240 00000100:00100000:1.0:1787853368.838136:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1787853368.838147:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4459680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:2399:x1874699472762240:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853368.838228:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4459680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:2399:x1874699472762240:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 82us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.838235:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1787853368.846442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.846493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.846538:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.846578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.846613:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762496 00000100:00100000:3.0:1787853368.846625:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762496 00000100:00100000:3.0:1787853368.846686:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763008 00000100:00100000:3.0:1787853368.846689:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763008 00000100:00100000:3.0:1787853368.846711:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1787853368.846722:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762496:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.846800:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762496:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.846807:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1787853368.846826:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1787853368.846831:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472763008:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.846897:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472763008:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.846904:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00080000:3.0:1787853368.846922:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853368.846949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.847009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.847080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.847119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.847147:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762624 00000100:00100000:3.0:1787853368.847150:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762624 00000100:00100000:3.0:1787853368.847173:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763136 00000100:00100000:3.0:1787853368.847176:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763136 00000100:00100000:3.0:1787853368.847189:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1787853368.847194:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762624:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.847227:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762624:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.847233:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1787853368.847245:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1787853368.847251:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472763136:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.847272:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472763136:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.847277:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00080000:3.0:1787853368.847290:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853368.847299:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763392 00000100:00100000:3.0:1787853368.847302:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763392 00000100:00100000:3.0:1787853368.847324:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762752 00000100:00100000:3.0:1787853368.847326:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762752 00000100:00100000:3.0:1787853368.847336:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762368 00000100:00100000:3.0:1787853368.847339:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762368 00000100:00100000:3.0:1787853368.847348:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472762880 00000100:00100000:3.0:1787853368.847350:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472762880 00000100:00100000:3.0:1787853368.847360:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1787853368.847365:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:2398:x1874699472762752:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.847392:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+12:2398:x1874699472762752:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.847406:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1787853368.847418:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1787853368.847423:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762368:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.847462:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472762368:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.847469:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1787853368.847481:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1787853368.847487:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472762880:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853368.847507:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2398:x1874699472762880:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853368.847525:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1787853368.847537:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1787853368.847543:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18728:x1874699472763392:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1787853368.847553:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853368.847573:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af343a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b3d expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.847682:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3200/0xe2bf4b958af3441 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.847697:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3200/0xe2bf4b958af3441 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.847710:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3200/0xe2bf4b958af3441 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853368.847732:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853368.847877:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af343a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b3d expref: 22 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.847899:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3200/0xe2bf4b958af3441 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b3d expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853368.847908:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:3.0:1787853368.847911:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853368.847915:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfe3c3200, rc 0) 00000100:00100000:3.0:1787853368.847935:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+21:18728:x1874699472763392:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 393us (1505us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787853368.847942:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000040:00080000:2.0:1787853368.850134:0:23452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787853368.862656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853368.862709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853368.862812:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763648 00000100:00100000:2.0:1787853368.862835:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763648 00000100:00100000:2.0:1787853368.862941:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1787853368.862952:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+21:2397:x1874699472763648:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853368.862968:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853368.862998:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3200/0xe2bf4b958af3441 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b3d expref: 21 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853368.863022:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:2.0:1787853368.863027:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853368.863094:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:2397:x1874699472763648:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 143us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853368.863102:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1787853368.863635:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763520 00000100:00100000:1.0:1787853368.863643:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763520 00000100:00100000:1.0:1787853368.863690:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1787853368.863699:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:18728:x1874699472763520:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1787853368.863759:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863776:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863796:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863833:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863872:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863879:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863885:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240000 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853368.863889:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863896:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863905:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853368.863908:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853368.863912:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853368.863918:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af344f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853368.863974:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:18728:x1874699472763520:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 276us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853368.863983:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1787853368.878294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853368.878428:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472763904 00000100:00100000:1.0:1787853368.878453:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472763904 00000100:00100000:1.0:1787853368.878525:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1787853368.878536:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:18728:x1874699472763904:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1787853368.878788:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+21:18728:x1874699472763904:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 253us (514us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1787853368.878797:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1787853369.226673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853369.226925:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472764160 00000100:00100000:3.0:1787853369.226937:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472764160 00000100:00100000:3.0:1787853369.227011:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1787853369.227024:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+21:18758:x1874699472764160:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1787853369.227058:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853369.227086:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af3456 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b44 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.227212:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af345d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.227248:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af345d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.227260:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af345d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853369.227284:0:25311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853369.227410:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af3456 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b44 expref: 24 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.227430:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af345d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b44 expref: 23 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.227439:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:3.0:1787853369.227441:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853369.227445:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfe3c3a00, rc 0) 00000100:00100000:3.0:1787853369.227520:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:18758:x1874699472764160:12345-192.168.201.29@tcp:101:cat.0 Request processed in 499us (869us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787853369.227527:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1787853369.230659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853369.230741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.230879:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472764288 00000100:00100000:0.0:1787853369.230889:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472764288 00000100:00100000:0.0:1787853369.230966:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1787853369.230976:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:2399:x1874699472764288:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853369.230992:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853369.231018:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3a00/0xe2bf4b958af345d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b44 expref: 23 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.231058:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:0.0:1787853369.231064:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853369.231121:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+22:2399:x1874699472764288:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 147us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.231129:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1787853369.231530:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472764544 00000100:00100000:1.0:1787853369.231535:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472764544 00000100:00100000:1.0:1787853369.231575:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1787853369.231583:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+22:18758:x1874699472764544:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:1.0:1787853369.231882:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:18758:x1874699472764544:12345-192.168.201.29@tcp:35:cat.0 Request processed in 299us (1139us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787853369.231890:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:1.0:1787853369.235219:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853369.323323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.325218:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472764800 00000100:00100000:1.0:1787853369.325234:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472764800 00000100:00100000:1.0:1787853369.325329:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1787853369.325342:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:18765:x1874699472764800:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1787853369.325378:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853369.325403:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af346b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b4b expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325533:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325550:0:24959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325591:0:24959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 24 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325600:0:24959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325640:0:24959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 24 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325668:0:24959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 24 pid: 22698 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853369.325683:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741824:192.168.201.29@tcp:104: 00010000:00010000:1.0:1787853369.325805:0:24959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.325815:0:24959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853369.325824:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaeeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741952:192.168.201.29@tcp:104: 00000100:00100000:1.0:1787853369.326624:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6614180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853369.331303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.331440:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472764928 00000100:00100000:0.0:1787853369.331451:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472764928 00010000:00010000:0.0:1787853369.331502:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 25 pid: 22698 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853369.331570:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1787853369.331579:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+25:2398:x1874699472764928:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853369.331599:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853369.331608:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 25 pid: 22698 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.331621:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 25 pid: 22698 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.331644:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:0.0:1787853369.331663:0:22684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.331673:0:22684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.331680:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853369.331744:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+25:2398:x1874699472764928:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 165us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.331752:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00010000:00010000:1.0:1787853369.332548:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c2400/0xe2bf4b958af3425 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b2f expref: 24 pid: 22698 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853369.332571:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaee8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741824:192.168.201.29@tcp:104: 00000100:00100000:1.0:1787853369.335532:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaeeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491741952:192.168.201.29@tcp:104: 00010000:00010000:1.0:1787853369.335580:0:24959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853369.339600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.339996:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765056 00000100:00100000:2.0:1787853369.340006:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765056 00010000:00010000:2.0:1787853369.340072:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853369.340117:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1787853369.340129:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac27d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+24:2399:x1874699472765056:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853369.340146:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853369.340153:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340166:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340210:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af3410 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b28 expref: 24 pid: 22700 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340227:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:2.0:1787853369.340233:0:22685:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340242:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340249:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.340283:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853369.340354:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac27d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:2399:x1874699472765056:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 227us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853369.340362:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00010000:00010000:1.0:1787853369.340923:0:24959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.340934:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853369.340954:0:24959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853369.341127:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af346b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b4b expref: 24 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.341144:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240600/0xe2bf4b958af3472 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b4b expref: 23 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.341152:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853369.341155:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853369.341157:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240600, rc 0) 00000100:00100000:1.0:1787853369.341207:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4458b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:18765:x1874699472764800:12345-192.168.201.29@tcp:101:dd.0 Request processed in 15868us (17896us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787853369.341215:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1787853369.349483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.349696:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765184 00000100:00100000:2.0:1787853369.349708:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765184 00000100:00100000:2.0:1787853369.349773:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1787853369.349784:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+23:18765:x1874699472765184:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1787853369.349812:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853369.349833:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795400/0xe2bf4b958af3480 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b52 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.349906:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.349936:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.349948:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.350083:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795400/0xe2bf4b958af3480 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 25 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.350102:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 24 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.350110:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:2.0:1787853369.350113:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853369.350116:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794e00, rc 0) 00000100:00100000:2.0:1787853369.350173:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+24:18765:x1874699472765184:12345-192.168.201.29@tcp:101:dd.0 Request processed in 392us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853369.350180:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1787853369.354692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.355079:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765440 00000100:00100000:0.0:1787853369.355090:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765440 00000100:00100000:0.0:1787853369.355151:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1787853369.355160:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+24:18765:x1874699472765440:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:0.0:1787853369.355422:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.355442:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.355452:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853369.355495:0:22699:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1787853369.355527:0:22699:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a0c1ee4 reply state 00000000127fec48 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.355541:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.355548:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:0.0:1787853369.355551:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787853369.355555:0:22699:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853369.356054:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472765440:12345-192.168.201.29@tcp:36:dd.0 Request processed in 891us (1371us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1787853369.356063:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000020:00080000:0.0:1787853369.356068:0:22699:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787853369.359266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.359416:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765568 00000100:00100000:1.0:1787853369.359427:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765568 00000100:00100000:1.0:1787853369.359496:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1787853369.359538:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472765568:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1787853369.359570:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853369.359604:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3495 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b59 expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.359804:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3495 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b59 expref: 28 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.359820:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3495 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b59 expref: 28 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.359965:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853369.359969:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853369.359973:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240000, rc 0) 00000100:00100000:1.0:1787853369.360086:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18765:x1874699472765568:12345-192.168.201.29@tcp:101:dd.0 Request processed in 581us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.360095:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1787853369.385313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853369.385441:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765824 00000100:00100000:3.0:1787853369.385452:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765824 00000100:00100000:3.0:1787853369.385526:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1787853369.385536:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18765:x1874699472765824:12345-192.168.201.29@tcp:103:dd.0 00010000:00010000:3.0:1787853369.385582:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853369.385607:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af3495 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b59 expref: 28 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.385625:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:3.0:1787853369.385631:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853369.386149:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472765824:12345-192.168.201.29@tcp:103:dd.0 Request processed in 613us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853369.386157:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1787853369.391461:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.391579:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472765952 00000100:00100000:0.0:1787853369.391590:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472765952 00000100:00100000:0.0:1787853369.391791:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1787853369.391803:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472765952:12345-192.168.201.29@tcp:58:dd.0 00010000:00010000:0.0:1787853369.391959:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.391995:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.392007:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853369.398033:0:25311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853369.398067:0:25311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787853369.398201:0:25311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787853369.398329:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472765952:12345-192.168.201.29@tcp:58:dd.0 Request processed in 6522us (6873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.398340:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1787853369.402185:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.402660:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766080 00000100:00100000:1.0:1787853369.402670:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766080 00000100:00100000:1.0:1787853369.402727:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1787853369.402736:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+27:18765:x1874699472766080:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1787853369.402756:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853369.402775:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b60 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.402825:0:22700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.402835:0:22700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 28 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.402885:0:22700:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.403112:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 28 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.403125:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853369.403128:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853369.403132:0:22700:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 28 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.403139:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfc240800, rc 0) 00000100:00100000:1.0:1787853369.403200:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18765:x1874699472766080:12345-192.168.201.29@tcp:101:dd.0 Request processed in 465us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.403207:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000040:00080000:2.0:1787853369.810546:0:22734:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787853369.810567:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853369.810596:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787853369.810605:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787853369.810756:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22734:1874699491742080:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853369.810883:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbf870a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853369.815124:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22734:1874699491742080:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853369.816796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.817080:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766208 00000100:00100000:2.0:1787853369.817088:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766208 00000100:00100000:2.0:1787853369.817223:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1787853369.817235:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18766:x1874699472766208:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853369.817281:0:22698:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853369.817403:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18766:x1874699472766208:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 170us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853369.817411:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1787853369.820936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.831057:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766336 00000100:00100000:1.0:1787853369.831074:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766336 00000100:00100000:1.0:1787853369.831148:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1787853369.831160:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18766:x1874699472766336:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787853369.831238:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831256:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831270:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831305:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831312:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831318:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831341:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831350:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831356:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853369.831400:0:22699:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787853369.831404:0:22699:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853369.831431:0:22699:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831443:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831449:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831456:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831472:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853369.831477:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831484:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831508:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfbfb627000) 00010000:00010000:1.0:1787853369.831511:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853369.831516:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831523:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240400/0xe2bf4b958af34aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831538:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831543:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831550:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831554:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240000 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853369.831557:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831563:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831582:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8cfbe01b9a00) 00010000:00010000:1.0:1787853369.831584:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853369.831587:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831592:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240000/0xe2bf4b958af34b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831606:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831613:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831631:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831636:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff3800 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853369.831639:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831645:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831653:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853369.831655:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853369.831657:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.831663:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3800/0xe2bf4b958af34b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853369.831758:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18766:x1874699472766336:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 600us (10832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.831767:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:3.0:1787853369.834224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.834552:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766592 00000100:00100000:1.0:1787853369.834561:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766592 00000100:00100000:1.0:1787853369.834624:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1787853369.834637:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+28:18766:x1874699472766592:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853369.834660:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853369.834679:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2a00/0xe2bf4b958af34bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b67 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.834915:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.834932:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.834942:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853369.834954:0:25311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853369.835043:0:25311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835051:0:25311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835075:0:25311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835081:0:25311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfe3c3600 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:3.0:1787853369.835085:0:25311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835092:0:25311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835104:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:3.0:1787853369.835107:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787853369.835112:0:25311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835118:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af34c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835339:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2a00/0xe2bf4b958af34bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b67 expref: 30 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835362:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfbfb627000) 00010000:00010000:3.0:1787853369.835365:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853369.835369:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2a00/0xe2bf4b958af34bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b67 expref: 30 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853369.835381:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff2a00, rc 0) 00000100:00100000:3.0:1787853369.835442:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+29:18766:x1874699472766592:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 808us (1227us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1787853369.835460:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1787853369.840600:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.840956:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766720 00000100:00100000:1.0:1787853369.840967:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766720 00000100:00100000:1.0:1787853369.841037:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1787853369.841047:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+29:18766:x1874699472766720:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853369.841085:0:22699:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853369.841220:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+29:18766:x1874699472766720:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 174us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.841229:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1787853369.847281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.847476:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472766976 00000100:00100000:0.0:1787853369.847505:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472766976 00000100:00100000:0.0:1787853369.847574:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1787853369.847583:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+29:18766:x1874699472766976:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853369.847607:0:24959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853369.847629:0:24959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af34d4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b6e expref: -99 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853369.848061:0:24959:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:0.0:1787853369.848068:0:24959:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1787853369.848087:0:24959:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1787853369.848230:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94e00/0xe2bf4b958af34db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.848246:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94e00/0xe2bf4b958af34db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.848276:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94e00/0xe2bf4b958af34db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.848332:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af34d4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b6e expref: 32 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.848348:0:24959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94e00/0xe2bf4b958af34db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b6e expref: 31 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.848356:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536a00) 00010000:00010000:0.0:1787853369.848359:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853369.848362:0:24959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd94e00, rc 0) 00000100:00100000:0.0:1787853369.848425:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+31:18766:x1874699472766976:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 842us (1159us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1787853369.848432:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:3.0:1787853369.853506:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.853685:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472767232 00000100:00100000:2.0:1787853369.853694:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472767232 00000100:00100000:2.0:1787853369.853753:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1787853369.853762:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+31:18766:x1874699472767232:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853369.853822:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853369.853891:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94e00/0xe2bf4b958af34db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b6e expref: 31 pid: 24959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.853909:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536a00) 00010000:00010000:2.0:1787853369.853920:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853369.853942:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.853957:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.853967:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.853981:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.853987:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854011:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854075:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854082:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854088:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854095:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4795e00 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.854099:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854106:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854115:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:2.0:1787853369.854118:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.854121:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854127:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4795e00/0xe2bf4b958af34e9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854139:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854145:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854158:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854163:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794000 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.854166:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854172:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854180:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd1308747 (ffff8cfbd5a61500) 00010000:00010000:2.0:1787853369.854183:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.854185:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.854191:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af34f0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd1308747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853369.854280:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+30:18766:x1874699472767232:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 518us (801us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853369.854288:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:1.0:1787853369.858721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.858913:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472767360 00000100:00100000:0.0:1787853369.858924:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472767360 00000100:00100000:0.0:1787853369.858988:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1787853369.858999:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaeead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+30:18766:x1874699472767360:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853369.859018:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853369.859043:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af34f7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b75 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859090:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95400/0xe2bf4b958af34fe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859102:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95400/0xe2bf4b958af34fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859128:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95400/0xe2bf4b958af34fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859254:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af34f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b75 expref: 32 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859590:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95400/0xe2bf4b958af34fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b75 expref: 31 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.859600:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:0.0:1787853369.859603:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853369.859607:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd95400, rc 0) 00000100:00100000:0.0:1787853369.859746:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaeead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+31:18766:x1874699472767360:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 748us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.859753:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1787853369.864620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.865393:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472767616 00000100:00100000:0.0:1787853369.865404:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472767616 00000100:00100000:0.0:1787853369.865504:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1787853369.865517:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+31:18766:x1874699472767616:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787853369.865692:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.865708:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.865719:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853369.865902:0:25311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1787853369.865910:0:25311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707929067414ns, next at 708929065746ns, rc = 0 00000004:00010000:0.0:1787853369.865956:0:25311:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b995235 reply state 000000007ecd3d95 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.865969:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.865976:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:0.0:1787853369.865980:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787853369.865982:0:25311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853369.866094:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+33:18766:x1874699472767616:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 580us (1485us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1787853369.866101:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1787853369.869409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.869963:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472767744 00000100:00100000:2.0:1787853369.869972:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472767744 00000100:00100000:2.0:1787853369.870025:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:2.0:1787853369.870034:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+33:18766:x1874699472767744:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853369.870058:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853369.870078:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b7c expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.870169:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 34 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.870184:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 34 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.870203:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:2.0:1787853369.870206:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853369.870210:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4794000, rc 0) 00000100:00100000:2.0:1787853369.870277:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+34:18766:x1874699472767744:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 243us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853369.870284:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1787853369.877998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.881385:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472767872 00000100:00100000:0.0:1787853369.881401:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472767872 00000100:00100000:1.0:1787853369.886869:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1787853369.886884:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2399:x1874699472767872:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787853369.887160:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2399:x1874699472767872:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 278us (9170us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1787853369.887168:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1787853369.890924:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.891080:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472768128 00000100:00100000:1.0:1787853369.891092:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472768128 00000100:00100000:1.0:1787853369.891158:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1787853369.891169:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+34:18766:x1874699472768128:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853369.891411:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+35:18766:x1874699472768128:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 244us (496us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1787853369.891419:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1787853369.894156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.894321:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472768384 00000100:00100000:0.0:1787853369.894331:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472768384 00000100:00100000:0.0:1787853369.894393:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1787853369.894402:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+35:18766:x1874699472768384:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853369.894532:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+35:18766:x1874699472768384:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.894540:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1787853369.899351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.899771:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472768512 00000100:00100000:1.0:1787853369.899781:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472768512 00000100:00100000:1.0:1787853369.899884:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1787853369.899894:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+35:18766:x1874699472768512:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853369.899914:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853369.899933:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af3513 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b83 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900001:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900015:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900026:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853369.900095:0:22699:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787853369.900114:0:22699:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900150:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3c00/0xe2bf4b958af3513 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b83 expref: 37 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900169:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b83 expref: 36 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853369.900177:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:1.0:1787853369.900180:0:22699:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853369.900183:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbcaff3400, rc 0) 00000100:00100000:1.0:1787853369.900247:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+36:18766:x1874699472768512:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 354us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.900255:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1787853369.905664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.905822:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472768640 00000100:00100000:2.0:1787853369.905832:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472768640 00000100:00100000:2.0:1787853369.905933:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1787853369.905943:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf02bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+6:2399:x1874699472768640:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853369.905961:0:24206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853369.905989:0:24206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b8a expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853369.906017:0:24206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907a3a, blocks: 0x0 00010000:00010000:2.0:1787853369.906038:0:24206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1787853369.906043:0:24206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853369.906053:0:24206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 7 pid: 24206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.906092:0:24206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 7 pid: 24206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.906106:0:24206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfac4795e00, rc 0) 00000100:00100000:2.0:1787853369.906185:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf02bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2399:x1874699472768640:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 243us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853369.906193:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1787853369.913126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.913482:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472768896 00000100:00100000:1.0:1787853369.913501:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472768896 00000100:00100000:1.0:1787853369.913568:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1787853369.913578:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+36:18766:x1874699472768896:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853369.913702:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+36:18766:x1874699472768896:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 124us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.913709:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:3.0:1787853369.927233:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1787853369.927679:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769024 00000100:00100000:2.0:1787853369.927690:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769024 00000100:00100000:2.0:1787853369.927750:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:2.0:1787853369.927759:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+36:18766:x1874699472769024:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787853369.931232:0:22678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1787853369.931248:0:22678:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787853369.931379:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931392:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931400:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931406:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbc0031800 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.931412:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931420:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931465:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cfbfb627500) 00010000:00010000:2.0:1787853369.931469:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.931473:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931490:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbc0031800/0xe2bf4b958af335a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931523:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931529:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931534:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931538:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcccb400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.931541:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931556:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931564:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:2.0:1787853369.931566:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.931570:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931575:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcccb400/0xe2bf4b958af3361 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931599:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931605:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931612:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931616:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc240200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.931619:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931626:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931635:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8cfbe01b9200) 00010000:00010000:2.0:1787853369.931649:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.931653:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931658:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240200/0xe2bf4b958af3409 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931673:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931679:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931684:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931696:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95000 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.931699:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931704:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931713:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:2.0:1787853369.931715:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853369.931717:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931723:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95000/0xe2bf4b958af348e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22699 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931735:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931740:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931745:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931750:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd95800 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:2.0:1787853369.931752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931758:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931775:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:2.0:1787853369.931777:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853369.931794:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853369.931801:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95800/0xe2bf4b958af3505 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853369.939276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491742208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787853369.939348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853369.939501:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491742208 00000100:00100000:2.0:1787853369.939509:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491742208 00000100:00100000:2.0:1787853369.939584:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853369.939594:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491742208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787853369.939731:0:24689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787853369.939735:0:24689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787853369.939738:0:24689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787853369.939740:0:24689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787853370 -> 1787853370 00002000:00010000:2.0:1787853369.939743:0:24689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:1.0:1787853369.939918:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787853369.941227:0:22678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1787853369.941306:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941331:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941339:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941345:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfc241200 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:0.0:1787853369.941350:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941357:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941375:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cfbfb627c00) 00010000:00010000:0.0:1787853369.941378:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787853369.941383:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.941389:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc241200/0xe2bf4b958af33ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853369.943970:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+15:18766:x1874699472769024:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 16201us (16739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853369.943983:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1787853369.949256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853369.949877:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769152 00000100:00100000:1.0:1787853369.949888:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769152 00000100:00100000:1.0:1787853369.949957:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1787853369.949969:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbff4ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2397:x1874699472769152:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787853369.950076:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbff4ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2397:x1874699472769152:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 109us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853369.950083:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1787853369.954065:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1874699491742208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 14458us (14701us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787853369.954082:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1787853369.961941:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfac4c04b40/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787853369.961957:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4c04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491742208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787853369.968078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.974386:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769408 00000100:00100000:0.0:1787853369.974403:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769408 00000100:00100000:0.0:1787853369.974470:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:0.0:1787853369.974480:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd29a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+15:18766:x1874699472769408:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787853369.974573:0:25311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853369.974601:0:25311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff3400/0xe2bf4b958af351a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b83 expref: 15 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.974622:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:0.0:1787853369.974628:0:25311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853369.974670:0:25311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af3528 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.974685:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af3528 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.974695:0:25311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af3528 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853369.974817:0:25311:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006f1fb1f reply state 00000000c12b310d transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af3528 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.974830:0:25311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd95e00/0xe2bf4b958af3528 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853369.974836:0:25311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:0.0:1787853369.974839:0:25311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787853369.974888:0:25311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853369.974989:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd29a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:18766:x1874699472769408:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 510us (6921us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1787853369.974996:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1787853369.981123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853369.981212:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769536 00000100:00100000:0.0:1787853369.981221:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769536 00000100:00100000:0.0:1787853369.981292:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1787853369.981317:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac44592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2399:x1874699472769536:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787853369.981469:0:24204:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787853369.981473:0:24204:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787853369 00002000:00010000:0.0:1787853369.981487:0:24204:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787853369 00002000:00010000:0.0:1787853369.981490:0:24204:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787853370 -> 1787853369 00002000:00010000:0.0:1787853369.981500:0:24204:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787853369.981572:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac44592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+8:2399:x1874699472769536:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 258us (460us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787853369.981581:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1787853370.000216:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491742336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787853370.000312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853370.000485:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491742336 00000100:00100000:0.0:1787853370.000502:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491742336 00000100:00100000:0.0:1787853370.000577:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853370.000587:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491742336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787853370.000620:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787853370.000684:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491742336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.000691:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853370.001003:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac445bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491742336:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787853370.001146:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853370.004223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.004333:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769664 00000100:00100000:0.0:1787853370.004343:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769664 00000100:00100000:0.0:1787853370.004419:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1787853370.004429:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+8:2397:x1874699472769664:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787853370.004486:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004531:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787853370.004535:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853370.004563:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004580:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004606:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004614:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004623:0:24207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004629:0:24207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94800 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853370.004633:0:24207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004813:0:24207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004830:0:24207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.004839:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0e5997/0xe2bf4b958af352f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.004964:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+8:2397:x1874699472769664:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 535us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.004972:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00080000:1.0:1787853370.005040:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853370.008514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.009138:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472769920 00000100:00100000:0.0:1787853370.009148:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472769920 00000100:00100000:0.0:1787853370.009280:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1787853370.009292:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:18766:x1874699472769920:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787853370.009374:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.009391:0:24959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.009400:0:24959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.009444:0:24959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.009457:0:24959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 16 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.009472:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742464:192.168.201.29@tcp:104: 00000100:00100000:0.0:1787853370.009871:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe026c840 going to sleep for 11 seconds 00000100:00080000:1.0:1787853370.009943:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853370.013663:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742464:192.168.201.29@tcp:104: 00010000:00010000:0.0:1787853370.013710:0:24959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853370.013885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.014057:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770048 00000100:00100000:0.0:1787853370.014064:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770048 00010000:00010000:0.0:1787853370.014098:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.014140:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1787853370.014150:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+17:2399:x1874699472770048:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853370.014166:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853370.014173:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014186:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014212:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794e00/0xe2bf4b958af3487 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b52 expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014229:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:0.0:1787853370.014236:0:22684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 16 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014246:0:22684:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014266:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014282:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.014313:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853370.014515:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:2399:x1874699472770048:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 365us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.014524:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:3.0:1787853370.015024:0:24959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015033:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015239:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015252:0:24959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015277:0:24959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015307:0:24959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 16 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.015321:0:24959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 16 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853370.015334:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742592:192.168.201.29@tcp:104: 00000100:00100000:3.0:1787853370.015399:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853370.019959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.020238:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770176 00000100:00100000:0.0:1787853370.020247:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770176 00000100:00100000:3.0:1787853370.020345:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742592:192.168.201.29@tcp:104: 00010000:00010000:3.0:1787853370.020368:0:24959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020597:0:22683:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.020732:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1787853370.020742:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+17:2398:x1874699472770176:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853370.020758:0:22683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853370.020764:0:22683:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020776:0:22683:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020798:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfac4794000/0xe2bf4b958af350c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b7c expref: 17 pid: 22698 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020814:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:0.0:1787853370.020818:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020875:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020883:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.020905:0:22683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853370.020966:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+16:2398:x1874699472770176:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 225us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.020974:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:3.0:1787853370.021391:0:24959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.021400:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853370.021536:0:24959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1787853370.021792:0:24959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1787853370.021831:0:24959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1787853370.021927:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24959:1874699491742720:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853370.021980:0:24959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853370.022009:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbe692b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853370.023211:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491742720 00000100:00100000:2.0:1787853370.023222:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491742720 00000100:00100000:2.0:1787853370.023289:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853370.023309:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24959:x1874699491742720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787853370.023415:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24959:x1874699491742720:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853370.023693:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac45b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24959:1874699491742720:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787853370.023912:0:24959:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787853370.023976:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf509f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24959:1874699491742848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787853370.024016:0:24959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853370.024042:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491742848 00000100:00100000:1.0:1787853370.024061:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491742848 00000100:00100000:1.0:1787853370.024086:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787853370.024092:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:24959:x1874699491742848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787853370.024193:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:24959:x1874699491742848:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (176us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1787853370.024199:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787853370.024221:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6614900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853370.024239:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf509f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24959:1874699491742848:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787853370.024285:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024308:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024316:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024323:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfe3c3600 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853370.024327:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024334:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024349:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:1.0:1787853370.024353:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853370.024358:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024365:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3600/0xe2bf4b958af353d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024398:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024405:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024411:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024416:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94400 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853370.024425:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024444:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024454:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853370.024457:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853370.024463:0:24959:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 19 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024484:0:24959:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 19 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024502:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 19 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.024564:0:24959:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfc240800/0xe2bf4b958af34a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b60 expref: 19 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853370.024576:0:24959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf509ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742976:192.168.201.29@tcp:105: 00000100:00100000:1.0:1787853370.024639:0:24959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6614180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853370.025536:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853370.029323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853370.029437:0:24959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf509ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24959:1874699491742976:192.168.201.29@tcp:105: 00010000:00010000:1.0:1787853370.029464:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029483:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94400/0xe2bf4b958af349c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029539:0:24959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029554:0:24959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029564:0:24959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029575:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029580:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029586:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029592:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2c00 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853370.029596:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029603:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029615:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853370.029617:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853370.029621:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029626:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbcaff2c00/0xe2bf4b958af3544 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029654:0:24959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029661:0:24959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029666:0:24959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029673:0:24959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfcd94000 already unused, calling callback (ffffffffc19484f0) 00010000:00010000:1.0:1787853370.029675:0:24959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029682:0:24959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029690:0:24959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:1.0:1787853370.029692:0:24959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787853370.029695:0:24959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.029700:0:24959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94000/0xe2bf4b958af3536 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853370.029887:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18766:x1874699472769920:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 20596us (21390us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787853370.029897:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000020:00080000:1.0:1787853370.029904:0:24959:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787853370.030175:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770304 00000100:00100000:3.0:1787853370.030182:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770304 00000100:00100000:3.0:1787853370.030235:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1787853370.030243:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfce4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18765:x1874699472770304:12345-192.168.201.29@tcp:49:dd.0 00000100:00100000:3.0:1787853370.030327:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfce4e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18765:x1874699472770304:12345-192.168.201.29@tcp:49:dd.0 Request processed in 85us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853370.030334:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000040:00080000:0.0:1787853370.031363:0:22734:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787853370.031370:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853370.031389:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787853370.031396:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787853370.035402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.035621:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770432 00000100:00100000:0.0:1787853370.035632:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770432 00000100:00100000:0.0:1787853370.035706:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:0.0:1787853370.035716:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+19:18765:x1874699472770432:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:0.0:1787853370.035737:0:22698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853370.035758:0:22698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94800/0xe2bf4b958af354b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53922e6c84125b91 expref: -99 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.035791:0:22698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94200/0xe2bf4b958af3552 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.035805:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94200/0xe2bf4b958af3552 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.035816:0:22698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94200/0xe2bf4b958af3552 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.035981:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94800/0xe2bf4b958af354b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b91 expref: 21 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.036000:0:22698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfcd94200/0xe2bf4b958af3552 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b91 expref: 20 pid: 22698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.036009:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cfbe01b9000) 00010000:00010000:0.0:1787853370.036011:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853370.036015:0:22698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfbfcd94200, rc 0) 00000100:00100000:0.0:1787853370.036068:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:18765:x1874699472770432:12345-192.168.201.29@tcp:101:dd.0 Request processed in 353us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.036075:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1787853370.041081:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1787853370.041831:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770688 00000100:00100000:3.0:1787853370.041885:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770688 00000100:00100000:3.0:1787853370.041950:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1787853370.041960:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+20:18766:x1874699472770688:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787853370.042244:0:22701:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787853370.042286:0:22701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1787853370.042320:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042337:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042349:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042358:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042365:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042371:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853370.042402:0:22701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853370.042516:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+22:18766:x1874699472770688:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 556us (1443us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787853370.042524:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000020:00080000:3.0:1787853370.042529:0:22701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853370.042662:0:22686:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853370.042668:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.042676:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbfe3c3400 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853370.042680:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.042688:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.042702:0:22686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cfbf1536300) 00010000:00010000:2.0:1787853370.042705:0:22686:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787853370.042709:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.042715:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfbfe3c3400/0xe2bf4b958af3559 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.042729:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853370.042731:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853370.042732:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853370.093935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853370.094127:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770816 00000100:00100000:1.0:1787853370.094141:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770816 00000100:00100000:1.0:1787853370.094198:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1787853370.094208:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4458780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+8:2398:x1874699472770816:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1787853370.094243:0:24210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.094276:0:24210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 8 pid: 24206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.094285:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853370.094288:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853370.094293:0:24210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.094323:0:24210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 8 pid: 24206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.094336:0:24210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 8 pid: 24206 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853370.094350:0:24210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf509e940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24210:1874699491743104:192.168.201.29@tcp:104: 00000100:00100000:1.0:1787853370.094439:0:24210:0:(client.c:2715:ptlrpc_set_wait()) set ffff8cfbc6614180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853370.098648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853370.098819:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771072 00000100:00100000:0.0:1787853370.098828:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771072 00010000:00010000:0.0:1787853370.098908:0:22684:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 9 pid: 24206 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.098944:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1787853370.098953:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:2398:x1874699472771072:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853370.098970:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853370.098990:0:22684:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 9 pid: 24206 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.099005:0:22684:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 9 pid: 24206 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.099055:0:22684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853370.099061:0:22684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853370.099067:0:22684:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.099076:0:22684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.099095:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853370.099157:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:2398:x1874699472771072:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853370.099164:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00010000:00010000:1.0:1787853370.099645:0:24210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bbaf0c5/0xe2bf4b958af3521 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x53922e6c84125b8a expref: 8 pid: 24206 timeout: 808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853370.099664:0:24210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf509e940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24210:1874699491743104:192.168.201.29@tcp:104: 00010000:00010000:1.0:1787853370.099693:0:24210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.099703:0:24210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853370.099710:0:24210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853370.110345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853370.112788:0:24212:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787853370.112803:0:24212:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787853370.114779:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472770944 00000100:00100000:0.0:1787853370.114792:0:24212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472770944 00000100:00100000:2.0:1787853370.116183:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1787853370.116202:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf60b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+9:2398:x1874699472770944:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1787853370.116241:0:25747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.116327:0:25747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853370.116333:0:25747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853370.116340:0:25747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.116354:0:25747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853370.256046:0:25022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1787853370.256067:0:25022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00010000:00010000:1.0:1787853370.256190:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787853370.256459:0:24210:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787853370.256464:0:24210:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1787853369 -> 1787853370 00002000:00010000:0.0:1787853370.256466:0:24210:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787853369 -> 1787853370 00002000:00010000:0.0:1787853370.256469:0:24210:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1787853370.256497:0:24210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256510:0:24210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256519:0:24210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256553:0:24210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfbcaff2c00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:0.0:1787853370.256558:0:24210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256567:0:24210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256584:0:24210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853370.256591:0:24210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1b3a8ca/0xe2bf4b958af3560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853370.260331:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4458780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b68e2f5e-4262-4d07-bfe9-53094ce47db6+7:2398:x1874699472770816:12345-192.168.201.29@tcp:4:dd.0 Request processed in 166110us (166392us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787853370.260357:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000001:00080000:0.0:1787853370.326038:0:25022:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1787853370.326229:0:25747:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1787853370.326234:0:25747:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1787853370.326262:0:25747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326276:0:25747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326285:0:25747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326292:0:25747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfac4794a00 already unused, calling callback (ffffffffc0d2a440) 00010000:00010000:2.0:1787853370.326297:0:25747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326320:0:25747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326340:0:25747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853370.326347:0:25747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc681d2/0xe2bf4b958af3567 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853370.326457:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf60b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2398:x1874699472770944:12345-192.168.201.29@tcp:4:dd.0 Request processed in 210256us (216117us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787853370.326468:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1787853371.024923:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853371.024999:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853371.025020:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491743360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787853371.025102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853371.025148:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743360 00000100:00100000:3.0:1787853371.025155:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743360 00000100:00100000:3.0:1787853371.025204:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787853371.025213:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491743360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787853371.025246:0:22703:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787853371.025289:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491743360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853371.025296:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787853371.025342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491743360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787853371.026295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853371.026309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853371.026353:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853371.026427:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743488 00000100:00100000:3.0:1787853371.026433:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743488 00000100:00100000:3.0:1787853371.026493:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853371.026502:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491743488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853371.026519:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787853371.026556:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874699491743488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853371.026578:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787853371.026694:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853371.026728:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1874699491743488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853371.027147:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbf509e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491743232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787853371.027192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853371.027334:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743232 00000100:00100000:3.0:1787853371.027339:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743232 00000100:00100000:3.0:1787853371.027375:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787853371.027383:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491743232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787853371.027408:0:23439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787853371.027453:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfc32de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491743232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853371.027459:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853371.027536:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbf509e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491743232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787853371.281511:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853371.536280:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491743616:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536418:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491744128:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536477:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874699491744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536502:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536530:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787853371.536535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491743744:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536588:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491744256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536623:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536649:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536693:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491743872:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491744384:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536774:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853371.536778:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbff4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491744000:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.536812:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfbcaf07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.536828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853371.537037:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743616 00000100:00100000:0.0:1787853371.537046:0:22691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743616 00000100:00100000:0.0:1787853371.537093:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787853371.537101:0:22691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3643:x1874699491743616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.537154:0:22691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbfdc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1465330-a4cf-4e7d-ab3b-959371f1d7aa+24:3643:x1874699491743616:12345-0@lo:400:kworker.0 Request processed in 54us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.537162:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787853371.537201:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744128 00000100:00100000:0.0:1787853371.537205:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744128 00000100:00100000:0.0:1787853371.537242:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743744 00000100:00100000:0.0:1787853371.537244:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743744 00000100:00100000:0.0:1787853371.537259:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744000 00000100:00100000:0.0:1787853371.537271:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744000 00000100:00100000:0.0:1787853371.537291:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853371.537297:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491744128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.537331:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874699491744128:12345-0@lo:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.537337:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853371.537347:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853371.537353:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.537375:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874699491743744:12345-0@lo:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.537381:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853371.537391:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787853371.537397:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491744000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.537432:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874699491744000:12345-0@lo:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.537437:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787853371.537453:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744640 00000100:00100000:0.0:1787853371.537456:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744640 00000100:00100000:0.0:1787853371.537491:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744256 00000100:00100000:0.0:1787853371.537495:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744256 00000100:00100000:0.0:1787853371.537505:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744768 00000100:00100000:0.0:1787853371.537507:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744768 00000100:00100000:0.0:1787853371.537517:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491743872 00000100:00100000:0.0:1787853371.537519:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491743872 00000100:00100000:0.0:1787853371.537528:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744384 00000100:00100000:0.0:1787853371.537530:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744384 00000100:00100000:0.0:1787853371.537540:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744512 00000100:00100000:0.0:1787853371.537543:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744512 00000100:00100000:0.0:1787853371.537555:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853371.537569:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874699491744640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853371.537603:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874699491744640:12345-0@lo:400:kworker.0 Request processed in 36us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.537608:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853371.537621:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853371.537628:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbcaf05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491744256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853371.538879:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853371.538902:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491744768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853371.538965:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874699491744768:12345-0@lo:400:kworker.0 Request processed in 74us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853371.538971:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853371.538990:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853371.538996:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491743872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853371.539038:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874699491743872:12345-0@lo:400:kworker.0 Request processed in 43us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853371.539044:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853371.539057:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787853371.539064:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491744384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853371.539089:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874699491744384:12345-0@lo:400:kworker.0 Request processed in 27us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853371.539095:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787853371.539106:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853371.539112:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac4d121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491744512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853371.539139:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac4d121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874699491744512:12345-0@lo:400:kworker.0 Request processed in 28us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853371.539144:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853371.539454:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853371.539483:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853371.539527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853371.539570:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491744896 00000100:00100000:2.0:1787853371.539578:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491744896 00000100:00100000:2.0:1787853371.539621:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853371.539628:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491744896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853371.539650:0:24208:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1787853371.539705:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac47503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874699491744896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853371.539712:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853371.539752:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1787853371.539759:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfac4c04b40, transno 12884901892 00000004:00080000:2.0:1787853371.539783:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1787853371.539816:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac4750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1874699491744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853371.540042:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787853371.540072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853371.540110:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787853371.540115:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853371.540119:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853371.540122:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853371.540146:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1874699491743744:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540159:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874699491744256:0@lo:400:kworker.0 00010000:00080000:3.0:1787853371.540174:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbcaf06580 x1874699491744768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853371.540184:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1874699491744768:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d1465330-a4cf-4e7d-ab3b-959371f1d7aa:3643:1874699491743616:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1874699491744128:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540213:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1874699491744640:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540265:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699491745024 00000100:00100000:3.0:1787853371.540269:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699491745024 00000100:00100000:3.0:1787853371.540295:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853371.540303:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfac3e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491745024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787853371.540314:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1787853371.540345:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfac3e8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874699491745024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853371.540351:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853371.540382:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1874699491744000:0@lo:400:kworker.0 00010000:00080000:3.0:1787853371.540395:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfbcaf07480 x1874699491744512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853371.540406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbcaf07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1874699491744512:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540419:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbff4ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874699491743872:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfbd558de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1874699491744384:0@lo:400:kworker.0 00000100:00100000:3.0:1787853371.540461:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8cfac45b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1874699491745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787853371.540651:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbcaf05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874699491744256:12345-0@lo:400:kworker.0 Request processed in 3019us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853371.540661:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:2.0:1787853372.113056:0:22734:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787853372.113066:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853372.113089:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787853372.113098:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:1.0:1787853372.272789:0:25784:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787853372.306674:0:22687:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853373.332700:0:22686:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853373.954649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.954688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.954753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.954778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853373.954826:0:22692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771200 00000100:00100000:0.0:1787853373.954835:0:22692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771200 00000100:00100000:0.0:1787853373.954922:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:0.0:1787853373.954933:0:22692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2396:x1874699472771200:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1787853373.955008:0:22692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbd2169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d4d2481-625b-4f67-b5fb-f788d42d4220+13:2396:x1874699472771200:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853373.955015:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1787853373.962893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.962940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1787853373.962995:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771712 00000100:00100000:0.0:1787853373.963004:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771712 00000100:00100000:0.0:1787853373.963079:0:24689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472772224 00000100:00100000:0.0:1787853373.963082:0:24689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472772224 00000100:00100000:0.0:1787853373.963104:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1787853373.963112:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1787853373.963180:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 69us (8427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853373.963188:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1787853373.963213:0:24689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1787853373.963218:0:24689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472772224:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1787853373.963243:0:24689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472772224:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853373.963249:0:24689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00080000:0.0:1787853373.963264:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853373.963523:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771456 00000100:00100000:2.0:1787853373.963529:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771456 00000100:00080000:2.0:1787853373.963560:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787853373.963865:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771968 00000100:00100000:2.0:1787853373.963870:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771968 00000100:00100000:2.0:1787853373.963905:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1787853373.963924:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771456:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1787853373.963962:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771456:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 50us (9273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853373.963968:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1787853373.963984:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:2.0:1787853373.963991:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472771968:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1787853373.964016:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472771968:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (9237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853373.964021:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00080000:2.0:1787853373.964039:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787853373.968685:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771328 00000100:00100000:3.0:1787853373.968699:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771328 00000100:00100000:3.0:1787853373.968780:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1787853373.968791:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+22:2396:x1874699472771328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1787853373.968900:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+22:2396:x1874699472771328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 111us (5959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853373.968908:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00080000:1.0:1787853373.969970:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853373.972353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.972392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.972447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1787853373.972643:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771840 00000100:00100000:1.0:1787853373.972653:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771840 00000100:00100000:1.0:1787853373.972716:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:1.0:1787853373.972729:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2396:x1874699472771840:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853373.972807:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:94714cf7-afeb-4188-9aff-dd0962db1ee7+6:2396:x1874699472771840:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 81us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853373.973004:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:1.0:1787853373.973030:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472771584 00000100:00100000:1.0:1787853373.973033:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472771584 00000100:00080000:2.0:1787853373.973284:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853373.973289:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853373.975332:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874699472772096 00000100:00100000:1.0:1787853373.975345:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874699472772096 00000100:00100000:1.0:1787853373.975398:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1787853373.975408:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1787853373.976642:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b68e2f5e-4262-4d07-bfe9-53094ce47db6+5:2396:x1874699472771584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1229us (4294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853373.976654:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1787853373.976679:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1787853373.976690:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfbf509e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472772096:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:3.0:1787853373.984723:0:22694:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853373.988369:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfbf509e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:94714cf7-afeb-4188-9aff-dd0962db1ee7+5:2396:x1874699472772096:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 11669us (15907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853373.988387:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 Debug log: 14174 lines, 14174 kept, 0 dropped, 0 bad.